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ABSTRACT 

Linear  optimal  control  theory  hae  produced  an  important  synthesis 
technique  for  the  dssign  of  linear  multivariable  systems.  In  the  present 
study*  efficient  design  procedures*  based  on  the  general  optimal  theory* 
have  been  developed.  These  procedures  make  use  of  design  techniques  which 
are  similar  to  the  conventional  methods  of  control  system  analysis.  Specifi¬ 
cally*  a  scalar  expression  is  developed  which  relates  the  closed-loop  poles 
of  the  multi-controller*  multi-output  optimal  system  to  the  weighting  param¬ 
eters  of  a  quadratic  performance  index*  Methods  analogous  to  the  root  locus 
and  Bode  plot  techniques  are  then  developed  for  the  systematic  analysis  of 
this  expression.  Examples  using  the  aircraft  longitudinal  equations  of  motion 
to  represent  the  object  to  be  controlled  are  presented  to  illustrate  design  pro¬ 
cedures  which  can  be  carried  out  in  either  the  lime  or  frequency  domains. 
Both  the  model-4n-the-per  forma  nee -index  and  model-following  concepts  are 
employed  in  several  of  the  examples  to  illustrate  the  model  approach  to 
optimal  design. 
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SECTION  I 
INTRODUCTION 

T‘ni»  report  describee  the  results  of  s  stud/  of  the  characteristics  of 
linear  optimal  control.  As  used  in  this  report*  a  system  describable  by  a  set 
of  constant-coefficient  linear  differential  equations  of  motion  is  said  to  be  lin¬ 
ear.  Optimal  control  is  a  technique  for  control  system  synthesis  by  which 
unique  control  input  motions  are  specified  that  minimize  a  functional  of  the  mo¬ 
tions  of  the  system.  This  functional  is  called  a  performance  index.  Linear 
optimal  control  is  an  optimal  control  synthesis  procedure  for  linear  systems 
whereby  the  control  motions  are  uniquely  determined  by  a  feedback  law  con¬ 
sisting  of  a  constant  linear  sum  of  the  variables,  or  states  of  the  system. 

Mathematically,  the  problem  can  be  defined  as  follows: 

For  some  initial  condition  of  the  state,  %  (o)  ,  find  the  control  ut  that 
minimizes  the  quadratic  performance  index 

A  CO 


2V  m  J (y'Qq  +  u'Qujdt 


subject  to  the  natural  constraint  of  the  linear,  constant  coefficient  equations  of 
motion  of  the  plant  written  in  the  first-order  form 

%  -  *  Q  a.  y  ■ 

The  performance  index  is  a  scalar  quantity  consisting  of  an  infinite  in¬ 
tegral  of  sums  of  quadratic  functions  of  the  outputs  and  the  control  inputs  to 
the  system.  Using  linear  optimal  control,  this  index  supersedes  all  conven¬ 
tional  performance  criteria  such  as  rise  time,  overshoot,  damping  ratio,  etc. 

It  becomes  necessary  then,  to  express  control  system  performance  in  terms 
of  the  elements  within  the  performance  index.  In  order  to  select  this  perform¬ 
ance  index  properly,  it  is  important  to  be  able  to  predict  the  closed-loop  char¬ 
acteristics  of  the  system  in  terms  of  conventional  performance  criteria.  If 
linear  optimal  control  can  satisfy  most  conventional  criteria,  it  will  be  a  use¬ 
ful  tool  for  linear  system  design.  If  it  inherently  provides  additional  advan¬ 
tages,  then  linear  optimal  control  becomes  an  important  tool  in  the  design  of 
linear  control  systems. 

In  this  report,  the  relationships  between  conventional  design  criteria 
and  optimal  design  criteria  are  investigated  to  determine  whether  or  not  op¬ 
timal  control  can  satisfy  conventional  design  criteria:  it  can.  In  addition, 
other  aspects  of  optimal  control  are  investigated  to  determine  if  additional  ad¬ 
vantages  exist  by  designing  a  system  using  linear  optimal  control.  They  do 
exist.  Seldom,  if  ever,  does  a  relatively  new  technique  produce  design  ad¬ 
vantages  without  limitations  and  disadvantages.  Linear  optimal  control  is  re¬ 
stricted  in  its  usage  and  does  possess  disadvantages  if  not  properly  used. 

Linear  optimal  control  is  a  general  multivariable  systhesis  technique. 
Multi-controller,  multi-output  systems  of  high  order  can  be  conceptually 
designed  very  quickly  using  a  digital  computer  and  a  unique  control  system 
will  be  specified  for  any  one  performance  index.  Using  conventional  techniques 
and  criteria,  a  multi-controller  design  can  be  a  tedious  chore.  Frequently, 


1 


T 


the  resulting  system  configuration  will  not  be  unique. 

The  use  of  linear  optimal  control  techniques  guarantees  that  the  re¬ 
sulting  closed-loop  system  will  h»  gt»Kie  The  complete  right  hdf  of  the  com¬ 
plex  frequency  plane  is  eliminated  as  an  area  where  closed-loop  roots  may 
exist.  This  feature  of  the  technique  can  be  important  when  the  vehicle  to  be 
controlled  is  inherently  unstable  or  flexible.  The  difficulty  is  that  it  may  not 
always  be  possible  to  physically  mechanise  a  system  designed  to  stabilize  an 
unstable  vehicle  or  to  minimize  bending  mode  flexibility. 

The  closed-loop  transient  response  of  a  linear  optimal  system  tends  to 
be  smooth  and  well  behaved.  As  the  output  is  weighted  heavily  with  respect  to 
the  control*  the  closed-loop  response  closely  resembles  the  response  of  a 
Butter  worth  filter,  whose  transient  response  has  little  overshoot  (  t  =  .707 
for  a  second-order  system)  and  whose  frequency  response  is  flat.  Frequently, 
a  linear  optimal  system  has  dynamic  characteristics  that  an  engineer  strives 
for  when  using  trial-and-error,  conventional  control  system  design  procedures. 
Using  optimal  techniques,  the  controller  motions  can  be  qualitatively  controlled. 
If  a  particular  optimal  design  requires  control  input  amplitudes  larger  than  is 
desired,  it  is  necessary  only  to  increase  the  weighting  of  the  control  portion 
within  the  performance  index,  penalizing  control  motions  more  heavily.  In  this 
way,  the  control  amplitudes  may  be  reduced  with,  of  course,  an  accompanying 
decrease  in  the  speed  of  response  of  the  closed-loop  system. 

The  primary  limitations  of  linear  optimal  control  lie  with  the  selection 
and  interpretation  of  the  performance  index  and  the  possible  difficulty  in  phy¬ 
sically  mechanizing  the  resulting  optimal  control  law.  It  appears  easiest  to 
select  a  performance  index  for  the  design  of  a  completely  automatic  regulating 
system.  For  instance,  it  is  not  difficult  to  conceive  of  a  performance  index  to 
satisfy  many  of  the  requirements  of  an  automatic  mid-air  refueling  system. 

In  this  application  it  is  possible  to  identify  dynamic  variables  that  must  be  min¬ 
imised,  such  as  relative  position  errors  between  the  two  aircraft  and  the  bend¬ 
ing  moments  of  the  refueling  aircraft.  On  the  other  hand,  it  is  not  known 
whether  a  quadratic  performance  index  can  be  selected  for  the  design  of  sta¬ 
bility  augmentation  systems.  Acceptable  flying  qualities  are  defined  in  terms 
of  conventional  dynamic  criteria,  such  as  short  period  natural  frequency, 
damping  ratio  and  lift  curve  slopes,  and  these  quantities  must  be  related  to 
linear  optimal  design  criteria  before  definite  judgments  can  be  made.  How¬ 
ever,  because  of  the  smoothness  and  generally  well  behaved  dynamic  charac¬ 
teristics  of  linear  optimal  systems,  there  is  reason  to  believe  that  systems 
designed  by  linear  optimal  techniques  will  be  judged  acceptable  for  manual 
operations. 

BACKGROUND 

The  solution  to  the  linear  optimal  control  problem  probably  evolved 
from  the  calculus  of  variations  but  its  significar  :e  was  not  fully  appreciated 
until  R.E.  Bellman  and  L.S.  Pontryagin  rigidly  stated  the  conditions  under 
which  an  optimum  exists.  The  complete  solution  in  the  time  domain  was  re¬ 
cently  obtained  by  at  least  two  prominent  control  system  theorists,  R.E.  Kal¬ 
man  (Reference  1)  and  C.W.  Merriam  III  (Reference  5).  Kalman  and  Merriam 
have  not  only  rigorously  obtained  mathematical  proofs  of  the  solution  and 
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related  theoretical  aspects  of  the  problem*  but  have  been  instrumental  in  de¬ 
veloping  digital  computer  programs  for  machine  solution  of  large  multi¬ 
controller  Droblems.  In  th«  fr»nn»ni'y  (|nmain  th®  origin®.!  work  by  Wiener 
was  extended  by  Mssrs.  G.  Newton*  L.  Gould  and  J.  Kaiser.  The  problem 
with  quadratic  control  constraint  was  solved  completely  in  the  scalar  case  by 

S. S.  L.  Chang  (Reference  3). 

Under  Air  Force  Contract  AF33(657)-7498,  the  Flight  Research  Depart¬ 
ment  of  the  Cornell  Aeronautical  Laboratory  investigated  the  application  of 
linear  optimal  control  techniques  to  several  control  system  problems  associ¬ 
ated  with  aerospace  vehicles  using  the  digital  computer  program  developed  by 

T. S.  Englar  and  R.E.  Kalman  (Reference  2). 

It  was  found  that  the  design  technique  has  definite  merit.  Stable*  well- 
behaved  closed-loop  systems  can  be  conceptually  specified  using  linear  optimal 
control  techniques.  Large  multivariable  systems  can  be  easily  handled  and 
many  closed-loop  optimal  systems  can  be  computed  in  a  relatively  short  per¬ 
iod  of  time.  It  was  also  discovered  that*  with  practice*  the  control  system 
designer  could  often  qualitatively  relate  the  parameters  of  the  performance 
index  to  those  dynamic  characteristics  known  to  yield  an  acceptable  flight  con¬ 
trol  system. 

This  report  describes  the  results  of  an  intensive  study  whose  objective 
was  to  obtain  relationships  among  the  performance  index  parameters  and  the 
closed-loop  optimal  dynamics.  The  results  show  that  the  weighting  parameters 
and  the  closed-loop  poles  are  directly  related.  Both  time  and  frequency  domain 
approaches  were  used  to  minimize  the  integral  performance  index.  The  time 
domain  approach  used  conventional  calculus  of  variations  techniques.  The  fre¬ 
quency  domain  approach  uses  Parseval's  theorem  in  the  manner  advanced  by 
S.S.  L.  Chang.  Equivalence  between  the  two  methods  can  be  demonstrated. 

The  time  domain  approach  uses  the  characteristic  equation  of  the  Euler - 
Lagrange  and  constraining  equations  to  obtain  a  root  square  locus  expression. 
The  optimal  control  is  shown  to  be  governed  by  the  matrix  Riccati  equation. 

The  frequency  domain  approach  shows  that  the  conditions  for  optimality  re¬ 
quire  the  solution  of  a  matrix  Wiener-Hopf  equation.  A  determinant  can  be 
extracted  from  the  Wiener-Hopf  equation  that  results  in  a  root  square  locus 
expression  for  the  closed-loop  poles.  The  optimal  control  can  be  obtained  by 
solving  the  Wiener-Hopf  equation  either  by: 

1.  spectral  factoring*  or 

2.  a  direct  solution  technique. 

Many  examples  (both  single -input  and  multi-input)  are  given  in  this  re¬ 
port  to  demonstrate  certain  characteristics  of  linear  optimal  control.  Exam¬ 
ples  of  the  root  square  locus  and  the  equivalent  Bode  plots  are  numerous. 

Many  of  the  examples  use  the  equations  of  longitudinal  aircraft  motion  to  des¬ 
cribe  the  object  to  be  controlled. 

The  use  of  models  to  obtain  a  desirable  closed-loop  optimal  system  is 
also  studied  in  this  report.  Specifically*  the  model  can  be  included  in  the  de¬ 
sign  objectives  in  two  ways:  the  model  can  be  included  in  the  design  as  an 
input  (as  an  uncontrollable  part  of  the  plant)  or  the  model  can  be  mathematically 
included  in  the  performance  index  only.  Examples  to  illustrate  model  proce¬ 
dures  are  given. 
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A  significant  start  has  been  made  on  the  problem  of  determining  use> 
ful  relationships  between  the  feedback  gains  and  the  performance  index.  In 
the  case  of  the  single  controller,  the  problem  has  been  solved  through  the  use 
of  the  root  square  locus  expression  as  a  design  aid.  For  the  single -input, 
single-output  case,  it  is  shown  that  a  performance  index  can  be  formulated  to 
yield  specific  feedback  gains,  closed-loop  frequencies  and  damping,  or  spe¬ 
cific  steady  state  characteristics  to  a  specified  input* 

The  report  describes  the  exact  relationships  that  exist  between  the 
performance  index  parameters  and  the  closed-loop  optimal  system  poles. 
Because  of  this,  one  of  the  primary  relationships  between  good  aircraft  fly¬ 
ing  qualities  and  optimal  control  characteristics  has  been  established.  How¬ 
ever,  more  research  is  necessary  to  describe,  in  a  usable,  easily  predictable 
form,  the  relationships  between  the  optimal  control  law  and  the  performance 
index. 


This  report  places  primary  emphasis  upon  the  relationships  that  exist 
among  the  parameters  of  the  performance  index  and  the  resulting  dynamic 
characteristics  of  the  closed-loop  optimal  system.  It  is  felt  that  a  basic  un¬ 
derstanding  of  these  relationships,  and  the  optimal  systems  that  they  produce, 
is  a  prerequisite  to  their  actual  application.  Optimal  control  can  be  another 
valuable  addition  to  the  design  tools  available  to  the  flight  control  system  de¬ 
signer.  Some  of  the  pertinent  areas  of  application  are  emphasized  in  the  ex¬ 
amples  included  in  this  report.  It  is  felt  that  this  report  will  contribute  to  a 
better  understanding  of  the  technique,  and  accelerate  its  application  to  appro¬ 
priate  problems  of  control  system  design. 

In  Section  2  the  optimal  regulator  of  a  second-order  single -input, 
single-output  system  is  obtained  using  the  notation  and  basic  techniques  of 
R.  S.  Kalman,  C.W.  Merriam  III,  L.S.  Fontryagin,  S.S.  L.  Chang  and  a  di¬ 
rect  solution  technique.  The  object  of  this  section  is  to  show  that  a  unique  op¬ 
timal  regulator  is  obtained  regardless  of  the  technique  used.  This  section 
also  shows  that  the  techniques  are  basically  the  same,  requiring  the  solution  of 
a  Riccati  equation  when  formulated  in  the  time  domain  and  a  Wiener-Hopf 
equation  when  formulated  in  the  frequency  domain. 

In  Section  3  of  this  report,  the  root  square  locus  expression  is  devel¬ 
oped.  The  integral  is  minimized  by  satisfying  the  Euler -Lagrange  equations, 
whose  characteristic  determinant  contains  the  closed- loop  poles  of  the  optimal 
system  and  adjoint.  This  characteristic  determinant  is  manipulated  into  a 
root  square  locus  expression.  Performance  indices  containing  control  rates, 
output  rates  and  models  are  considered,  and  the  corresponding  root  square 
locus  expressions  are  obtained. 

Section  4  discusses  some  of  the  aspects  of  the  single-input  system, 
and  shows  that  the  problem  is  simply  solved.  The  performance  index  can  be 
related  to  the  closed-loop  dynamics  and  the  optimal  feedback  gains,  A  per¬ 
formance  index  can  be  formulated  to  yield  a  predetermined  feedback  gain, 
including  no  feedback  from  a  state  variable,  if  desired.  In  general,  however, 
negative  values  of  in  the  performance  index  must  be  allowed. 

Section  5  shows  how  optimal  control  techniques  can  be  effectively  used 
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to  specify  a  control  system  design  for  the  longitudinal  short  period  control  of 
a  modern,  high  performance  fighter  aircraft. 

The  theory  of  the  optimal  control  law  for  a  system  with  a  single  control 
variable  and  a  single  output  variable,  using  the  frequency  domain  technique  of 
S.S.  L.  Chang,  is  considered  in  Section  6.  Several  examples  are  given  to  il¬ 
lustrate  the  application  of  the  method  and  to  point  out  some  difficult  points 
which  occur  in  the  theory.  The  equivalence  between  Chang's  method  and  the 
time  domain  approach  is  demonstrated. 

The  frequency  domain  approach  of  Section  6  is  extended  to  the  multi- 
variable  situation  in  Section  7,  It  is  shown  that  the  frequency  domain  relation 
of  interest  is  a  matrix  equation  of  the  Wiener-Hopf  type.  This  matrix  equation 
can  then  be  solved  using  either  of  two  methods: 

1.  spectral  factorization,  or 

2.  a  direct  method. 

Examples  are  given  to  demonstrate  the  factorization  approach  and  the  direct 
method. 


A  subsection  is  included  to  show  how  one  arrives  at  the  matrix  Wiener- 
Hopf  equation  when  the  basic  description  of  the  system  is  given  in  terms  of 
transfer  functions  rather  than  a  set  of  first-order  differential  equations.  The 
section  concludes  with  a  theoretical  development  of  the  model -following  tech¬ 
nique  and  a  method  for  synthesizing  the  feedback  gains  required  by  the  optimal 
solution. 

In  Section  8,  the  use  of  Bode  plots  in  linear  optimal  design  is  outlined 
in  detail.  A  relatively  complicated  design  problem,  involving  a  jet  fighter 
in  a  power  approach,  is  used  to  illustrate  the  application  of  the  concept.  The 
section  concludes  with  the  outline  of  a  frequency  domain  design  procedure. 

A  more  complex  multivariable  example  of  the  use  of  the  root  square 
locus  and  the  equivalent  Bode  plots  is  given  in  Section  9.  The  problems  of 
dynamically  matching  a  small  jet  to  a  proposed  supersonic  transport  are  il¬ 
lustrated  using  both  the  model-in-the-performance-index  technique  and  the 
model-following  concept. 

This  report  is  concerned  with  the  solution  of  the  problem  involving  a 
quadratic  performance  index.  This  index  has  shown  to  yield  acceptable  de¬ 
signs  for  many  applications.  One  can  always  speculate  on  whether  or  not  a 
better  design  would  have  been  obtained  if  a  different  performance  index  had 
been  used  as  the  design  criteria.  Several  excellent  reports  have  been  written 
describing  the  characteristics  of  systems  designed  using  other  performance 
indices  (for  instance,  see  References  16  and  17)  and  solutions  to  these  prob¬ 
lems  using  a  suitable  and  realistic  control  constraint  may  eventually  lead  to  a 
very  useful  set  of  design  tools  for  the  practicing  engineer. 

READER'S  GUIDE 

Most  of  the  comments  on  the  uses  and  abuses  of  linear  optimal  control 
are  contained  within  the  introduction  and  conclusions  of  this  report.  Those 
who  are  not  mathematically  minded,  or  those  busy  management  people  who 
decline  to  become  too  technically  involved  are  urged  to  read  only  the  Abstract, 
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Introduction  and  Conclusions. 

Those  who  are  more  theoretically  inclined  would  find  Sections  3  and  7 
most  challenging.  Section  3  contains  most  of  the  developments  in  the  time  do¬ 
main  and  is  the  source  for  the  derivation  of  the  multi-output,  multi-controller 
root  square  locus  expression.  Section  7  derives  the  frequency  domain  matrix 
Wiener -Hopf  equation  and  describes  a  direct  method  for  solving  the  Wiener- 
Hopf  equation. 

The  engineer  interested  in  optimal  control,  but  either  not  familiar  with 
matrix  manipulations  or  who  prefers  relatively  simple  examples,  will  find  that 
Sections  2,  4  and  6  will  provide  him  with  a  fair  understanding  of  the  relation¬ 
ships  between  conventional  and  optimal  design  procedures. 

Section  5  illustrates  how  the  root  square  locus  concept  might  be  used 
for  flight  control  system  analysis  and  conceptual  design,  while  Section  8  out¬ 
lines  the  use  of  Bode  plots  in  linear  optimal  design. 

Finally,  two  multi-output,  multi-controller  examples  are  presented  in 
Section  9  in  connection  with  the  use  of  models  to  obtain  satisfactory  and  ac¬ 
ceptable  linear  optimal  control  system  designs. 

Therefore,  a  reader  may  satisfy  his  curiosity  about  linear  optimal  con¬ 
trol  to  any  extent  he  desires.  It  is  hoped  that  many  will  find  the  time  to  ex¬ 
amine  the  contents  of  this  report  in  detail,  for  it  is  believed  by  the  authors 
that  a  powerful  linear  control  system  design  technique  will  soon  develop  from 
linear  optimal  theory. 
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SECTION  2 

SURVEY  OF  LINjliAjk.  kj!c  iImAL  buLUxIuN  X’ECHwiwuEs 

2. 1  INTRODUCTION 

As  a  technical  introduction  to  a  study  of  linear  optimal  control,  it  was 
decided  to  review  some  of  the  solution  techniques  in  use  today*  This  review 
is  accomplished  by  solving  the  same  simple  problem  using  several  of  these 
techniques.  This  section  serves  to  illustrate  that  the  techniques  are  quite 
similar,  and  all  require  the  solution  of  a  Riccati  equation  or  its  equivalent. 
Because  the  solution  to  the  linear  optimal  control  problem  is  unique,  these 
similarities  should  come  as  no  surprise.  The  main  differences  lie  in  the  gen¬ 
erality  of  the  problem  that  can  be  solved,  and  these  differences  are  briefly 
discussed  at  the  end  of  the  section.  Although  this  section  serves  as  back¬ 
ground  material,  knowledge  of  the  contents  is  not  a  prerequisite  to  under¬ 
standing  the  technical  developments  of  later  sections. 

We  shall  choose  as  a  simple  example  the  single-input,  single-output 
second-order  system  completely  describable  by  the  transfer  function 

urw  iT77«nr  <J-1» 

It  is  desired  to  find  the  optimal  control  law  that  minimises  the  integral 

2V  m  f  (w9*  (2-2) 

0 

for  any  initial  condition  on  the  state  vector . 

2.2  THE  METHOD  ATTRIBUTABLE  TOR.E.  KALMAN  (REFERENCE  1) 

It  is  necessary  to  write  the  transfer  function  Equation  2-1  in  first- 
order  equation  form, 

%  »  F %  +  Qu  y  -  (2-3) 

Specifically,  for  this  example  there  results 
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It  has  been  proved  (Reference  1)  that  the  solution  to  this  problem  can  be  ex¬ 
pressed  as  a  feedback  control  law 

U#«  (2-5) 

where  P  is  the  steady  state  solution  of  the  matrix  Riccati  equation 

1>m  PF tF'P-PGIZ-tG'P (2-6) 

The  matrix  P  is  symmetrical  and  has  two  solutions.  Kalman  has  shown 
that  one  solution  will  yield  a  realisable  closed-loop  system,  guaranteed  sta¬ 
bility  of  the  closed  loop  for  the  sufficient  condition  of  non-negative  definite 
Q  and  positive  definite  R  matrices.  This  can  be  shown  by  considering  the 
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integrand  of  the  performance  index  to  be  a  Lyapounov  Function,  but  this  proof 
will  not  be  shown  here. 

The  solution  to  the  particular  example  of  this  section  can  be  obtained 
by  substituting  the  appropriate  matrices  into  the  Riccati  equation  (2-6)  and 
solving  for  the  steady  state  of  the  P  matrix. 
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This  yields  the  three  following  scalar  equations 
0  -  -  —  *  9 
o- 

0  "  2<p,t  '  2*Pn  " 

Solving,  there  results  for  and  : 
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(2-7) 


(2-8) 


The  optimal  feedback  control  law  is  given  by 

U.0  -  -Uv  -  -e-'a'p* 
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The  closed-loop  optimal  regulator  is  given  by: 
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2.  3  THE  METHOD  OF  MERR1AM  (REFERENCE  5) 

The  system  ie  again  written  in  the  first-order  form: 

£  ■  F%  +  Gu  y  m 
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The  performance  index  ie 

W-t  £,  /[(!*, <« 

T 

where 

T  *  t  a  r 


(2*12) 


Richard  Bellman  has  proven  that  the  relationship  that  minimises  E  is  given  by 

£$  f* *0  (2-13) 

where 

£Lm  *L  +  i£* 

dt  9t  9*  *  (2-14) 


Substituting  2-12  and  2-14  into  2*13,  and  realising  that  as  T  approaches  infin¬ 
ity  E(t)  approaches  a  constant  value  and  9£/9t  *  0,  the  result  is 

tnhtu  I  f*,*  +  rug*  —  —  (-ttXf-aXg  +  au))  -  0  (2-15) 

[  9*»  9*t  | 

Differentiating  with  respect  to  u  yields  the  control  law  that  minimises  Equa¬ 
tion  2-15,  and  therefore  the  performance  index. 

9E 

2ra  *  e  -  -  0 
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Merriam  now  assumes  the  following  form  for  E: 

w  tt  » 

£  •  k  -m  2  H  It-  (i)  It-  It)  *  £  £  ii_-  (t)  %— 

m.t  «  -  •  •  m-t  fi  t  .  r 


-  ic  -  2^,  -  is,  * t)  f  £„  *«  n  *  *2/  **  *t  *  ' 
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(2-17) 


where  the  k's  are  constants  resulting  from  the  requirement  that  T«*>  eo  in  the 
performance  index. 

Then,  assuming  that  ktt  -  lett 

•—  -  +  *>,  +  kit  *i) 

(2-18) 

Substituting  Equation  2-18  into  2-16  yields 

uc  m  jr  ftr**  *»-*«**)  (2-i9) 

Now  substituting  2-19  into  2-15  yields  an  expression  from  which  the  constants 
k  can  be  determined. 

~  (^t  “  ^ta  '  ^12  %»)  *  2%x(-k,  +  ittf  4  kti  fca  j 

+  2 (-kt *  ktt %t  *  klt  %x)  [- b%t-atet*~  (kt - k)t  x,  - kl7  %tj]  -  0 

L  r  J  (2-20) 

Expanding  and  equating  terms  of  the  same  powers  of  %  to  zero  yields 


the  following  set  of  quadratic  equations! 

Powers  in  yt° 
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It  is  clear  that  Equations  2- 21c,  d  and  f  are  the  same  as  Equations 
2-8.  It  can  also  be  seen  from  Equation  2-21a  and  e  that  kt  and  kg  are  zero 
for  this  example.  Therefore* 

kij  -  fij 

ity  of  Equation  2-21 
of  Equation  2-8 

and  Equation  2-16  may  be  written  the  same  as  Equation  2-10*  leading  to  the 
identical  closed-loop  optimal  system. 

2.4  PONTRYAGIN'S  TECHNIQUE  (REFERENCE  4) 

Pontryagin  also  uses  the  first-order  form  to  define  a  linear  system: 

*,  -  *1 

if  -  -  A  +  Cu 

The  performance  index  is  defined  as 


*„-£,/  (*•••*  r**)* 
4 


To  the  original  system  a  new  vector  is  added*  and  the  new  system  is 
defir  ed  as  follows: 


&0  »  ru* 

f*  •  m  -bx(  -  aiCf  *  eu 


(2-22) 


A  Hamiltonian  function  3Cm  E  f*  is  generated*  which  for  this  par¬ 
ticular  example  becomes:  *m° 


m  fj  rui)+f?ffts  +  (-b%t-axt+cu) 


(2-23) 


A  second  function  M  m  is  defined.  From  theorem  1  (Reference  4*  page 

19).  n)  »  0  and  since  the  system  is  linear  and  continuous* 

M(f,  «/  ■  «  **  -* 


a* 


Substituting*  there  results 


99t 

9u. 


-  2f0  ru9  *  t,  *  -  0 


from  which  the  optimal  control  law  is  obtained 


C  ft 

2r  to 


(2-24) 
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Substituting  2-24  into  2-23  gives  the  result 

0  -  [W*r  /-li  <• 


r9  / 


r*/j 


(2-25) 


The  Hamiltonian  is  such  to  satisfy  the  Hamiltonian  system  of  partial 
differential  equations 


i£  -  - 


**/ 


4  *  •  *  *  ft 

t  m  t$2$  •  ••  tf 


(2*26) 


Therefore*  Vi  is  a  constant  and  can  be  set  equal  to  1.  Performing  the  oper¬ 
ations  of  Equation  2-26,  the  result  is 


(2-27) 


-  2q%f  +  bt$ 

a) 

b) 

x* 

c) 

-b%,  -a%t-  -  — 

'  2r 

d) 

Equations  2-27  define  the  optimal  system  and  they  must  be  solved  to 
obtain  the  expression  for  the  synthesis  of  the  optimal  system.  It  can  be  shown 
that  a  solution  will  be  obtained  by  assuming 

1?  ■  *,  *  <tn  *. 

t,  ' 

where  the  are  constant  for  this  problem. 

i,  * 
i. 


(2-28) 


Substituting  2-28  and  2-27c  and  d  into  2-27a  and  b,  and  grouping  terms  in  xf 
and  xt  yields 
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*«  i  <-o„y  ° 

xi  (37  ’  ^«<I1*Mi/)-  o  <2-2” 


Equation  2-29  la  satisfied  if  the  following  three  equations  are  satisfied. 


-=£•  q,*  *  **^»  *  *f  -  fl 

0„  40,  ■  6<K„  ♦  0„  -  0 

0j  -  2*4,  ♦  20„  -  0 


But  Equations  2-30  are  identical  to  the  Riccati  equations  2-8  when  (ty 
is  set  equal  to  tfij  again  demonstrating  that  the  optimal  system  requires  a 
solution  of  the  same  set  of  equations  and*  of  course*  yields  identical  results. 

2.  5  THE  METHOD  OF  CHANG  (REFERENCE  3) 

Chang's  method  was  designed  for  deterministic  and  statistical  inputs* 
and  is  hot  directly  applicable  to  the  regulator  problem.  However*  using  the 
theory  extension  described  in  Section  6. 3*  the  optimal  system  can  be  obtained. 


Figure  1.  Single  Output  Block  Diagram 

The  block  diagram  of  Figure  1  where 

W(s)  *  fixed  system  elements  (transfer  function) 
u(s)  ■  control  (input  to  the  fixed  elements) 

R(s)  *  closed- loop  system  input 
e(s)  *  error  signal 

Wc(s)  ■  compensating  network  (to  be  designed  once  the 
optimal  u  is  specified) 
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» r  • 


lead*  to  the  Wiener -Hopf  equation: 

[i*»  W(>)  V(-s)\u, -  W(->)  Vto  -  -}(!) 


when  the  performance  index  is 

Of 

2V'f(e‘*Pu')<K 


(2-31) 

(2-32) 


In  Equation  2-31,  y  (s)  represents  a  rational  polynomial  that  can  have 
no  poles  in  the  left-half  plane  while  the  optimal  control,  ud  ,  can  have  no  poles 
in  the  rightrhalf  plane. 


The  solution  to  Equation  2-31  is 

f  ["  wy-s yec*) 

V  (•)  I  Y(-*) 


U* 


•]. 


(2-33) 


where  the  symbol  [  means  that  one  expands 

W(-s)  K<f) 

Yf-S) 

in  partial  fractions  and  retains  only  those  terms  with  left-half  plane  poles. 


The  term  Y  -  (jfc**  W(a)W(-s)J+ 
is  found  by  factoring  k*  *  W(s)W(-s) 

into  a  product  with  one  component  having  all  its  poles  and  zeros  in  the  left- 
half  plane  while  the  other  has  right-half  plane  poles  and  zero.  One  then  picks 

(it**  W(i)  IVf-sjl* 

to  be  the  left-half  plane  factor.  1  1 

For  this  example,  the  equivalent  regulator  formulation  is 


W(s) m 

m- 


a 

s^  T&sTb 


where  a,  b,  and  c  have  the  same  meaning  as  the  previous  examples.  %t(o)  and 
Xt(0)  are  initial  conditions.  Applying  Equation  2-31,  one  finds 


(» *z<°) 

(a*..  a.»  +  b)(s2  +  as+b) 

*  S*-48  +  b 

6  %*-as4-b 

By  direct  substitution  into  Equation  2-33,  the  optimal  control  is  found  to  be 


f 

c[(B+a)%,(o)+  xt(a)] 

L*+  c*  j+ 

(  T**-as*b)(5**<t5*bjj 

IS  'pjcspSKlwJ  J 

(2-35) 
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which  simplifies  to 


s  2*as*b 
77m  —  irr 

\  9  f  cia  *  *7/ 


c[(s+a)xt(o)  +  %t  (O)] 

y9S-KS+  jb)($z  +  ocs  tty  J 


/  *7  7  4  \ 


where  .  . 

2b)sl+b2+  -  (s*-tf5+  0)^5**  are +  £()  (2-37) 

In  Equation  2-36,  only  the  roots  of  the  equation  s*  +  as  +  b  *  0  contribute 
to  the  partial  fraction  expansion. 


Solving  for  3  and  <£  ,  in  terms  of  a  and  b,  one  finds 


(2-38) 


The  closed-loop  natural  frequency  is  given  by  Equation  2-38  and  agrees 
with  the  results  obtained  by  the  other  methods. 

State  vectors  do  not  appear  in  this  frequency  domain  formulation  of  the 
problem  and  one  cannot  use  the  equation 

ue  -  -k:% 

to  synthesize  the  feedback  configuration.  However,  one  can  choose  to  work 
with  the  block  diagram  of  Figure  2  and  the  performance  index 

ZV  •  f  (ez *L*u*)dt 
o 

where  e  "  %  -  C  is  the  system  error.  The  feedback  found  would  be  identical  to 
that  found  using  the  other  solution  techniques. 


Figure  2.  Alternate  Block  Diagram 
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2, 6  DIRECT  SOLUTION 

It  can  be  shown  that  there  is  really  no  need,  for  relatively  simple 
single-inpuL  single-output  systems  as  used  in  this  example,  to  resort  to  the 
step-by-step  procedures  of  optimal  control  system  synthesis  nnti<n«ri  in  “sing 
the  techniques  of  Kalman,  Pontryagin,  Merriam  or  Chang  in  determining  the 
optimal  feedback  control  law.  The  feedback  gains  can  be  obtained  directly 
from  the  expressions  for  the  optimal  closed-loop  regulator  and  its  adjoint 
(i.e.i  its  right-half  plane  mirror  image).  The  optimal  feedback  control  law 
is  shown  by  Kalman  to  be  of  the  form 

Ud  -  -Id  16 

and  the  closed-loop  optimal  system  is 

it  -  (F-aid)v 

whose  characteristic  equation  is 

|ls- (F-CUd)\^  0  (2-39) 


The  spectral  factored  product  of  the  characteristic  equation  of  the  op¬ 
timal  system  and  its  adjoint  is  given  by 

|  Is-(F-Gld)  \\-l9-(F-Gld)'\-0  (2-40) 


It  will  be  shown  in  Section  3,  specifically  Equation  3-20,  that  the  char¬ 
acteristic  equation  of  the  optimal  system  and  its  adjoint  is  given  by: 


I9-F  <3£-'G' 

-bt'QU  -Is-F' 


Equating  Equations  2-40  and  2-41  will  yield  expressions  relating  the  feedback 
gains  K  with  F,  G,  H,  Q  and  R  of  the  optimal  system.  There  results 


\l*-(F-GK)  -Is-(F-<2V)' 


Is-F  aiS-'G' 
-HW  -Is-F’ 


(2-42) 


Substituting  the  parameters  of  the  particular  example  that  is  being  used. 


s  -1 

O 

"V 

i 

S  -10  0 

b  s+a  0  *%• 

b  +  <&kt  9*  a*  ck$ 

•f  -3  *<L+0kz 

-q  0  -s  b 

0  0-1  -s  fa 

[$t+s(k+<i4x)+(iHc4fj][s*-sfa+64f)t-(b+<i4/jl*  (s**a9+6)(s*-49+b)+  ^-3- 
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-V 


Therefore: 

s4-  ^[(b+akt)*- 2(b+&l‘t)\+[b+eAt)*m  **(&*- 2b) +b*+  —■ 

Equating  powers  of  s  yields: 

k!+2±tt-  ±k,  -d 

c  c 

k,*+  2*i  -±  *o 

a  r 


T> 


9  e 


7 


(2-43) 


(2-44) 


These  feedback  gains  again  lead  to  the  same  optimal  systems  as  obtained  by 
the  other  techniques* 

The  advantages  of  this  direct  solution  are  clear.  The  feedback  gains 
are  expressed  directly  as  function  of  q  and  r.  The  right-hand  side  of  Equation 
2-42  is  the  expression  from  which  the  root  square  locus  is  derived.  A  root 
square  locus  can  be  performed  beforehand,  yielding  the  values  of  the  closed- 
loop  left-hand  plane  roots.  A  polynomial  can  be  formed  by  these  roots  and 
equated  directly  to  the  characteristic  equation  of  the  optimal  system.  Equa¬ 
tion  2-39.  The  feedback  gains  would  then  be  obtained  as  linear  functions  of 
the  coefficients  of  the  polynomial  formed  from  the  root  square  locus  plot. 

A  numerical  example  of  this  technique  is  given  in  Section  5  where  it  is 
also  shown  that  the  q‘s  and  r’s  can  be  chosen  to  yield  feedback  gains  from  se¬ 
lected  parameters  of  the  system.  It  should  be  cautioned,  however,  that  this 
technique  has  been  found  to  work  only  for  single -input  systems.  If  a  multi- 
variable  optimal  system  must  be  designed,  the  Riccati  equation  must  be  solved 
or  the  technique  of  Section  7  must  be  used. 

The  similarities  between  these  techniques  of  solution  for  linear  systems 
are  apparent.  They  all  lead  to  a  set  of  quadratic  equations,  the  matrix  Riccati 
equation.  The  method  of  proof  of  the  existence  of  the  optimum  varies  some¬ 
what  between  the  different  methods  of  solution,  but  the  greatest  difference 
among  the  techniques  is  the  notational  language  used.  The  similarities  can  be 
summarized  briefly  in  a  few  paragraphs. 

Bellman,  of  course,  is  famous  for  his  Principle  of  Optimality  and  dy¬ 
namic  programming.  He  has  demonstrated  that  the  optimal  solution  using  the 
performance  criterion  . 

P 

V  •  J  Ku.*)dt  (2-45) 
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is  obtained  from  the  equation 

mt*  /a** 


9U 


U 


0* 


IHaL 

9 * 


‘*1 


(2-46) 


where 

Kpt  T  Jt'(Q%l+Vul)dt 

and  Merriam  obtained  a  synthesis  of  the  optimal  system  in  closed  form  by 
assuming  a  form  for  V^pt  ’ 


(2-47) 


Kalman  demonstrated  that  Equation  2-46  was  essentially  the  Hamilton  - 
Jacobi  partial  differential  equation 


**(*.?>*) -° 

(2-48) 

where 

2+1*,**)- {«**'e*V-*) 

(2-49) 

where  Kalman's 

■p  *  - c— 

S% 

(2-50) 

Kalman  also  demonstrated  that  the  solution  to  the  Hamilton- Jacobi  equation  is 
equivalent  to  a  solution  of  the  canonical  equations 

*9*  »  <2-51) 

r 


If  the  space  X  x  U  is  unbounded,  the  canonical  equations  can  be  reduced 
to  the  Riccati  quadratic  first-order  differential  equation 

-p.pF  +  F'P-'PGV-’G'P+N'QH  (2-52) 


by  substituting  p  =  Px  into  the  canonical  equations.  The  matrices  F,  G  and  H 
are  the  plant  matrices  as  defined  by  Kalman. 

Pontryagin  has  proven  the  existence  of  the  function  ,  which  when 

maximized  with  respect  to  the  control  u,  can  lead  to  the  optimum  control  sys¬ 
tem.  It  is  clear  that  Pontryagin's  adjoint  variable,  7^  ,  Kalman's  co-state,  p, 
and  Bellman's  gradient  vector,  9Vcpi  J 9%  ,  are  related  by  constants  for  the 
linear  system. 

For  the  simple  example  illustrated  in  this  section,  any  of  these  solu¬ 
tion  techniques  can  be  used  with  about  equal  ease.  The  major  differences  in 
the  methods  lie  with  the  types  of  problems  that  can  be  solved. 
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The  maximum  principle  appears  applicable  to  almost  every  type  of  dy¬ 
namic  system,  linear  or  nonlinear,  and  the  widest  variety  of  performance 
criterion.  It  is  not  a  solution  technique,  however.  The  maximum  principle 
states  the  conditions  under  which  an  optimum  exists,  but  it  is  up  to  the  ingen¬ 
uity  of  the  design  engineer  to  find  a  solution  to  the  Hamiltonian  system  of 
equations  that  maximizes  the  Hamiltonian  function. 

It  appears  that  the  parameter  expansion  method  of  Merriam  and  the 
method  attributable  to  Kalman  are  capable  of  solving  the  same  variety  of  prob¬ 
lems.  Time -varying  systems,  having  finite  or  infinite  performance  index 
integrals,  are  handled  by  either  method  and  there  appears  to  be  no  basic  lim¬ 
itation  to  the  order  of  the  system  or  the  number  of  control  inputs. 

The  frequency  domain  solution  method  requires  a  performance  index 
in  which  the  upper  limit  is  infinity  and  a  plant  that  has  a  Laplace  transform 
description.  These  requirements  admit  the  existence  of  a  transport  lag,  or 
time  delay,  which  do  not  invalidate  the  solution  technique.  The  frequency  do¬ 
main  approach  to  linear  optimal  control  shows  how  a  time  delay  is  to  be  treated 
This  is  not  apparent  when  using  the  time  domain  approach  of  Merriam  or 
Kalman. 

The  direct  solution  technique  is  the  simplest  and  the  easiest  to  perform, 
particularly  if  a  root  square  locus  plot  is  used  to  spectral  factor  the  poles  of 
the  optimal  system  and  its  adjoint.  At  present,  this  technique  applies  only  to 
single-input  systems,  but  it  should  be  extendable  to  multi-input  systems. 


SECTION  3 

THE  ROOT  SQUARE  LOCUS 


3. 1  THE  GENERAL  PROBLEM 

S.S.  L.  Chang  (Reference  3)  has  shown  that  there  can  be  associated 
with  optimal  systems  involving  a  quadratic  performance  index,  a  root  square 
locus  plot  involving  the  poles  of  the  optimal  system  and  the  adjoint  (right- 
half  plane  image)  system*  Dr.  Chang  considered  only  single -control,  single- 
output  systems,  however,  and  it  is  of  definite  interest  to  expand  this  concept. 

A  digital  program  now  exists  to  obtain  the  optimum  of  large,  multivariable 
systems,  but  there  is  no  quantitative  method  for  predicting  the  closed-loop 
roots  of  the  optimum  system.  A  multivariable  root  square  locus  expression 
will  help  the  control  system  designer  relate  the  parameters  of  the  perform¬ 
ance  index  to  the  dynamics  of  the  closed-loop  optimal  system.  It  is  desired 
to  obtain  a  matrix  multivariable  expression  for  the  poles  of  the  closed-loop 
optimal  system.  It  is  also  of  interest  to  obtain  expressions  for  the  root  square 
locus  of  quadr atic  performance  index  forms  containing  the  derivatives  of  the 
control  and  the  output  variables. 

The  use  of  an  integral  whose  upper  limit  approaches  infinity,  and 
whose  integrand  is  a  quadratic  function  of  the  state  and  the  control  variables 
of  a  linear  system,  to  express  control  system  requirements  can  be  formulated 
as  a  standard  problem  in  the  theory  of  the  Calculus  of  Variations.  The  exact 
problem  is  treated  in  almost  any  standard  text  (see,  for  instance,  C.  Fox, 
"Introduction  to  the  Calculus  of  Variations'1 ,  Oxford,  1950,  Sec.  4.8,  p.  94). 

The  general  variational  problem  treated  is  to  find  the  extremum  of 
the  integral  *i 

V  •  J  U,d,  t)dt  (3-1) 

subject  to  the  differential  constraint 


(3-2) 


By  taking  the  appropriate  variations  (see  Fox),  the  two  classical  Euler - 
Lagrange  partial  differential  equations  are  obtained:  (two  equations  because 
there  are  two  dependent  variables) 

9YI  d  tdn\  r  9M  d  L9m\ 1 

9%  “  dt  \dk j  [*  9%~dt\9t) J 

*.±(s*).\x  .o 

9u  it\aij  [  9u  M\  Sti  / 

These  Euler -Lagrange  equations  can  be  obtained  another  way.  Define 
a  function 


( X  an  arbitrary 
function  of  time  ,, 
that  is  to  be 
determined) 

(3-4) 
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(3-5) 

The  Euler  -Lagrange  equations  are  then  simply: 

9X_  _  a_  /££)  _  0 

9*  dt  \9tJ  (3-61 

M  d  lax \  _  0  <3-7> 

an'  dt  l  aa/ 

The  phase  of  linear  optimal  control  of  immediate  interest  falls  within 
the  general  form  of  Equations  3-1  and  3-2  with*  however*  several  important 
limitations. 

1.  The  constraining  equation  is  linear. 

2.  The  integrand  contains  quadratic  forms  only. 

3.  The  limits  of  the  integral  are  usually  taken  between 
zero  and  infinity. 


With  these  alterations*  the  problem  can  be  defined  as  follows: 
Determine  the  control  u  that  minimises  the  integral 
co 


2V  -  f  (*'Q%  urRu  *  + 

A 

icaUt  product*  \  ,jj. 

(3-8) 

V 

subject  to  the  constraint 

-X  *  F#  +  -  0 

y  - 

(3-9) 

where  Q  and  S  are  non-negative  definite  symmetric  matrices  (the  non-negative 
requirement  guarantees  stability*  a  sufficient  but  not  a  necessary  condition). 

R  and  T  are  positive  definite. 

F  is  an  n  x  n  system  matrix 

G  is  an  n  x  p  input  matrix  describing  the  effect  of  an 
input  on  the  system. 

The  solutions  to  the  problem  stated  above  require  at  least  piecewise 
existence  of  the  second  time  derivative  of  the  dependent  variables  x  and  u  . 

3. 2  THE  ROOT  SQUARE  LOCUS  DERIVATION 

The  linear  optimal  problem  usually  formulated  is  a  simplification  of 
the  more  general  equations  (3-8  and  3-9).  The  integral  to  be  minimised  is: 

to  «  CO 

ZM- J  n(%,  u)dt  .  J  (t/Vgtu.'eu)dt  -  j  (v'H'OHtut'B*)#  <3-10> 

CO  0 

The  constraining  equation  is*  as  usual* 

+  (3u  -  O  (3-11) 
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The  Lagranglan  is  formed 

*  4  n  +  -  l  u'2uUX’-{-V'  +  F’«  +  <2u) 

*  a  *  r 

Obtaining  the  gradients  as  indicated  by  the  Euler  equations  (3-6  and  3-7), 

—  «  Y  *  r’\  m  H'QHv+r'X 


9X  / 

—  «  f  (Vu  +  eu)+a'z  -  vu  +  a'x 


The  Euler  equations  reduce  to 

i  +  H'QHx*  F’%  *  0  (3-12) 

2a  *  G'%  -  0  (3-13) 

Solving  Equation  3-13  for  a  yields  the  control  (  U0  )  that  minimizes  the 
integral.  Equation  3-10: 

U0  -  -13~f<2'%  (3-14) 


There  are  three  equations  then  that  define  the  optimal  system;  the 
two  Euler  equations  and  the  restraining  equation.  These  three  equations  are, 
in  a  partitioned  matrix  form: 


r*i 

F  G  0 

~  y 

(a) 

i — - 

o 

i _ _ 

« 

o  n  g ' 

0  -F’ 

a 

l 

(b)  (3-15) 

(c) 

It  has  been  shown  by  Kalman  and  others  that  the  control  law  is  governed  by  a 
matrix  equation  called  the  Riccati  equation.  To  obtain  this  matrix  Riccati 
equation,  substitute  Equation  3-14  into  3-15a  and  consider  the  resulting  equa¬ 
tion  along  with  3- 15c: 


*  -F»  +G2-* G'X  -  0  (a) 

H’QHX*  i+Ff  %  -  0  (b) 


(3-16) 


Then  let  X  •  Px  ,  X  m  Py+P%  .  Substituting  for  i  into  Equation  3-l6b 
and  multiplying  Equation  3-  16a  by  P  yields: 


Py  .  pry  y  PG2’fGrPy  -  0 
H'QFv  +  Py  +  Py  +  F'P%  -  0 


P  is  a  symmetric 
matrix  which  is 
a  function  of  time 


(a) 

(3-17) 

(b) 
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Solving  for  Pi  in  Equation  3-1 7a  and  substituting  into  Equation  3-1 7b 

yields 

or  -  P%  -  VF%  +  F'P%-  PCaS’* CP*. 

-t>  mpf  +  F'P-PGG~,G'P  +  V'QtS  (3-18) 

which  is  the  matrix  Riccati  equation. 

Kalman  (Reference  1)  has  shown  that  Y  ( 0)rP(°*)n> (0)  is  the  optimum  val¬ 
ue  of  the  performance  index*  whose  value  approaches  a  constant  as  the  upper 
limit  of  the  performance  index  approaches  infinity.  Because  this  report  only 
treats  the  performance  index  whose  upper  limit  is  infinite*  the  steady  state 
solution  of  the  Riccati  equation  is  required.  Setting  the  left-hand  side  of 
Equation  3-18  to  sero  yields  the  solution  for  P(o»)  *  and  therefore  the  value 
of  %  mP(m)%(i)  for  the  optimal  feedback  control  law  of  Equation  3-14. 

The  Riccati  equation  is  a  matrix  quadratic  equation  in  P.  It  has* 
therefore*  two  solutions  and  it  is  found  that  one  solution  yields  a  stable  clostfd- 
loop  optimal  system*  and  the  other  produces  an  unstable  adjoint*  or  image 
solution.  Because  it  can  be  shown  that  the  performance  index  V  is  a  Lypanounov 
function  (Reference  1)*  the  optimal  closed-loop  system  for  this  case  is  stable. 
The  Riccati  equation  therefore  yields  an  optimal  and  stable  closed-loop  solution. 


To  demonstrate  the  character  of  the  closed-loop  roots  of  the  optimal 
system  and  its  adjoint*  take  the  Laplace  transform  of  Equation  3-l6a  and  the 
negative  of  Equation  3-l6b 


Js-F  ]  Q1S’fC  *(s)  %(0) 

-  - - I -  a 

‘F’Qb/  i  -ra-rV  X(s)  -Uc) 


(3-19) 


The  characteristic  equation  of  the  closed-loop  set  of  Equations  3-19  is 
given  by  the  determinant  expression 

I  Js-F  <3 I 


&(-*)&(*)  * 


(3-20) 


-I5-F' 


This  determinant  contains  the  closed-loop  poles  of  the  complete  optimal 
solution;  therefore  it  must  have  a  stable  left-half  plane  set  of  poles  and  an  un¬ 
stable  set  of  closed-loop  poles.  Letov  (Reference  15)  has  proven  that  i £/*/(•) 
is  a  root  of  Equation  3-20*  /U{(~%)  must  also  be  a  root.  Assume  that  the 
terms  H'QH  and  GR~lG'  are  sero*  that  is*  there  is  no  performance  index  as¬ 
sociated  with  the  problem*  and  the  system  is  open  loop.  Under  these  condi¬ 
tions*  the  adjoint  system  is  merely  the  adjoint  of  the  plant.  Equation  3-20 

b.com«.  I  Xt.fr  0  I 


JS-F' 


■  Is-F  -Js-F'  **0  (3-21) 


Equation  3-21  then  expresses  a  system  whose  roots  are  images  of  each 
other  reflected  about  the  \**>  axis  of  a  complex  frequency  s -plane*  where 
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•  *  cr  *  jo>  •  Notice  that  if  the  original  system  #•  F%  *  Ga  is  unstable,  ita 
adjoint  it  »-F'm  ia  atable  and  vice  veraa.  Alao,  if  the  original  plant  contained 
both  a  atable  and  an  unatable  part,  the  adjoint  would  have  both  a  atable  and  an 
unatable  part,  with  the  unatable  part  of  the  plant  new  the  stable  part  of  the 
adjoint.  Equation  3-21  contains  two  complete  sets  of  poles.  In  the  left-half 
plane  are  the  atable  part  of  the  plant  and  the  stable  part  of  the  adjoint.  The 
right-half  plane  contains  the  unstable  plant  polea  and  the  reflected  atable 
plant  poles.  Now  add  a  performance  index  to  the  problem,  i.e.,  assume  that 
H'QH  and  GR*lG'  terms  in  Equation  3-20  are  finite,  with  the  GR-lG'  term 
much  smaller  than  the  H'QH  term.  The  roots  of  the  determinant  of  Equation 
3-20  change  slightly  from  their  open-loop  values  of  Equation  3-21.  The  sig¬ 
nificant  observation  is  that  those  roots  of  Equation  3-?0  that  start  out  in  the 
left-half  plane  always  remain  in  the  left-half  plane  (for  Q  non-negative 
definite  and  R  positive  definite)  and  those  roots  in  the  right-half  plane  remain 
in  the  right-half  plane.  The  roots  in  the  left-half  plane  are  the  poles  of  the 
optimal  realisable  system.  It  will  be  shown  that  the  roots  of  Equation  3_-20. 
and  therefore  the  poles  of  the  optimal  system  (and  its  adioint)  move,  as  a  very 
definite  function  of  Q  and  R.  in  a  manner  describable  by  a  root  square  locus. 

Before  an  expression  for  the  multivariable  root  square  locus  is  de¬ 
veloped*  it  is  important  to  notice  that  if  the  system  matrix  F  is  of  order  n, 
the  determinant  of  Equation  3-19,  which  defines  the  closed-loop  system  and 
its  adjoint,  contains  exactly  2n  closed-loop  roots.  The  Riccati  equation  has 
2  n  solutions  as  well;  n  solutions  which  define  a  stable  closed-loop  system 
and  n  which  define  an  unstable  system.  The  realizable  closed-loop  system 
will  therefore  have  n  stable  poles,  exactly  the  same  number  as  the  open -loop 
system. 

The  determinant  of  Equation  3-19  defines  the  roots  of  the  closed-loop 
optimal  system  and  its  adjoint,  and  it  can  certainly  be  used  to  find  these  poles, 
but  a  more  convenient  and  useful  expression  can  be  developed  to  conform  with 
S.S.  L.  Chang's  single-input,  single-output  expression  of  Reference  3, 


The  variational  equations  obtained  after  taking  a  Laplace  transform  of 
Equations  3-15  and  rearranging,  are: 


•Is -F* 
0 


-H'QH 

Is-F 


O 

-G 


"  X(s)~ 

X(o)~ 

v($) 

m 

*(o) 

„  u(s)  _ 

0 

G'  0  B 

where  the  roots  of  the  optimal  system  and  its  adjoint  are  given  by 

-Is-F'  -H'QH  O 

0  Is-F  -G  I  -  0 

G*  0  2 


(3-22) 


(3-23) 


This  determinant  can  be  conveniently  expanded  by  using  the  Generalised 
Algorithm  of  Gauss  (see,  for  instance,  F.R.  Gantmacher,  "Matrix  Theory", 
Chelsea  Publishing,  I960).  The  resulting  expression  is 
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&(t)  &(•$)  o  (3.24) 

which  hold*  if  [Is  -  F],  [-Is  -  F']  are  square  and  for  values  of  s  such  that 
lls  ■  FM  0,  |-I»  •  F  N  0.  The  determinants  \  I«  -  F  J  mm  A  J  -I-  w  p«  j  a?e  *w_ 
determinants  that  define  the  characteristic  equations  of  the  open-loop  system 
and  its  adjoint.  By  definition,  they  are  the  determinants  of  square  matrices 
and  are  equal  to  sero  only  at  the  values  of  s  equal  to  the  open* loop  poles  of 
the  system.  r  r  " 

Defining  |ls-r|  ■  D  |-Xs-r#|-p 

Equation  3-24  can  be  written 

However,  since  DD  *  0  defines  the  poles  of  the  open-loop  plant  and  its  adjoint, 
they  are  not  part  of  the  closed-loop  optimal  system  and  adjoint.  The  scalar 

re**‘on  that  defines  the  locus  of  poles  of  the  closed-loop  system  and  its 
adjoint  is  given  by 


„r  1 2+a’  W  [u-n'e  I  -  o 

I  [i.-rj'V  |  ■  o  (J.„, 

Equation  3-25  defines  a  root  square  locus.  The  form  is  conventional  and  all 
of  the  root  locus  techniques  now  in  use  can  be  employed  to  solve  Equation  3-25. 

It  is  shown  in  Appendix  I  that  Equation  3-25  can  be  written  in  the  form 


r+ie 


where,  by  definition, 


[if [-£<.>]  . 


(3-26) 
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(3-27) 
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Trv 
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i*  a  matrix  of  transfer  or  weighting  functions  of  the  n  outputs  to  the  p  inputs 
to  the  open-loop  system*  It  has  been  found  convenient  to  use  the  symbol 

(*)  J  °n  occasion  during  this  report  for  the  purpose  of  compactness 

and  because  it  is  not  realistic  to  define  a  division  process  in  matrix  notation. 

It  is  also  found  that 

<3'[-r.-rTV  •  K<»-  [£<-»]  ,3-281 

is  the  triuispose  of  Equation  3-27  with  s  replaced  by  -s. 

In  other  words* 


SANE  INPUT  VARIAILE 


Ui 


— i  (*s)  •  •  • 

U1 

.£*»  •  •  • 

*1_ 

uf 


(•*) 


*(-s) 


(-s) 


(3-29) 


So  it  can  be  seen  that  the  matrix  form  of  the  multivariable  root  square 
locus  is  very  similar  to  the  form  described  by  Chang  (Reference  3)  for  the 
scalar*  single-input*  single -output  case. 

Several  short  examples  will  demonstrate  the  computations  involved  in 
the  root  square  locus  expression. 

Single-Input,  Single -Output  System 

Consider  the  system  described  simply  by  the  transfer  function 

-£-(*)  -  ur(a)  -  ~(s) 

and  the  design  criterion,  or  performance  index 


ZVm  J (%<il  *  rul)dt 


where 


u 

* 

r 


-  the  output  of  the  system 
=  the  input  to  the  system 

=  a  scalar*  the  weighting  parameter  for  the  output 
=  a  scalar,  the  weighting  parameter  for  the  input 


Substituting  into  the  expression  for  the  root  square  locus  yields 

<L  u  u  s  A/  V 

'"FT  il,,m  "7j  <-’>  tT  <•>  *  0 


(3-30) 
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This  is  of  exactly  the  same  form  as  developed  in  Reference  3* 
Sinsle-OutDUt.  Dual-Innii* 

Consider  the  single-output»  dual-input  system  as  shown  in  the  block 
diagram  below: 


Let  the  performance  index  be  M 

*V-/  rtut*)<l* 

o 


The  expression  for  the  root  square  locus  becomes: 


ui*< 


in  '  <•) 


u*r<~'  if  w+ri'  ir%  (-•>  ■%;  <a>  "  0 


(3-31) 


It  can  be  seen  that  the  closed-loop  poles  of  the  optimal  system  and  its 
adjoint  are  a  function  of  two  parameters!  9  /  #*#  and  9  /  f*g  *  Equation  3-31 
can  be  written  r~  y  y 

0  -  1*  - !  ±(.s>£.f)  1* 


'i  «» 


r‘  &<-*■*« 
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Two  individual  root  square  loci  are  required,  with  parameters  qjrt  and 

r,/rt  . 

Two -Input,  Two-Output  System 

As  a  final  example,  consider  the  two-input,  two-output  system  as 
shown  below. 


Vi 


with  the  design  performance  criterion 

* 


2v  ■  rf  (y'9y+ u',2u)£tt 

•• 

- 1 f  fa*** uik* ****** +  *»***)* 


Substituting  in  Equation  3-26  as  before  the  root  square  locus  expression  be¬ 
comes 


or 
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which  expands  to: 
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(3-32) 


It  would  appear  from  Equation  3-32  that  the  last  term,  with  /(D5)*  , 
would  produce  a  puzzling  situation,  where  the  number  of  closed-loop  roots 
would  be  doubled.  It  has  been  shown,  however,  that  the  expression  for  the 
root  square  locus  is  derived  from  Equation  3-23,  which  contains  only  2n  roots, 
those  of  the  optimal  system  and  its  adjoint*  It  must  be  then  that  a  factor  DS 
is  common  to  both  the  numerator  and  the  denominator  of  the  last  term  of 
Equation  3-32.  Such  a  factor  is  in  fact  common  to  both  numerator  and  denom¬ 
inator,  and  this  can  be  shown  by  an  expansion  of  minors  of  the  original  F  ma¬ 
trix  from  which  the  transfer  functions  were  obtained* 

Consider  the  last  term  in  Equation  3-32,  which  can  be  written 

”  */-,«»*  ~ —  (V*  Ntt  “  )  fttt  *ss  “  ) 

(VD)Z 

where 

H„ Nu  - Nn  N„  -  |  tf  [Is-F]  |  (3.33) 


and  where  the  H,  G  and  F  matrices  come  from  the  original  equations  of  motion 

£  -  F*  *  <Su>  u  * 

7  (3-34) 

If  Equation  3-34  is  of  second  order  and  there  are  two  inputs  and  two  outputs, 
there  appears  in  the  root  square  locus 

(N„Nu-HnN„)  -  |- |w||[i.-rj"!||a|  ,3.35, 

(H  and  G  must  be  square) 


Equation  3-35  can  be  written 


»m  , 


IWu- NmNM)  -  |«||rs-F|  |<3  | 

since  |[rs-F]*^|  *  |Xs-F|  (Reference  14,  page  42). 


(3-36) 


I 


I 

1 


■  V:  »  • 


For  a  second-order  system,  n  =  2  and  Equation  3-36  is  reducible  to 

K  'Vi*  -  'Vf*  'v*fj  -  i 

so  that  the  last  term  in  Equation  3-32  becomes 


{3-3 f/ 


9,  %  rr'r,''  KN»-"n «, «,  r.'VI«l  *  |0|*  CP 

(OC)2  fpB)2 

(5_38) 

P5 

If  H  and  G  are  not  square,  the  system  reduces  to  a  single -input,  single- 
output  problem  and  the  term  in  the  root  square  locus  given  by  Equation  3-38 
does  not  exist. 

For  the  vast  majority  of  systems,  G  and  H  are  not  square,  but  the 
same  kind  of  cancellation  has  been  shown  to  occur  in  every  example  that  has 
been  tried.  As  an  example,  consider  the  fourth-order  system: 
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(3-39) 


The  "transfer  function"  or  weighting  function  matrix 
becomes: 
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Using  the  determinant  identity  (see  for  instance  Network  Analysis  and  Feed 
back  Amplifier  Design,  by  Bode,  page  54). 

1^1  *»b,ed  "  **b  *cd  ~*6d  *eb 


where  |  A|is  any  determinant 

a,  c  are  any  two  deleted  rows  of  |A| 

b,  d  are  any  two  deleted  columns  of  I  A| 
Aab{  cd  called  the  second  minor  of  I  A| 
Ajj  is  called  the  first  minor  of  JA I 


Equation  3-41  becomes: 
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*  I-  _|  }  9ft  9gf  *19,34  “  931  U*  *  **>  43*(9v9h  '  9ft  949)*  14,49  I 
'  (3-42) 

This  proves  that  for  this  example,  |  la  -  Fj  cancels  out  of  the  last  term 
in  the  root  square  locus.  Appendix  II  describes  in  more  detail  the  proof  that 
I  Is  -  F||  -Is  -  F1  j  is  common  to  the  quadratic  terms  in  the  root  square  locus 
expression!  showing  that  the  quadratic  terms  can  be  obtained  from  an  expan¬ 
sion  of  minors  after  the  columns  of  the  G  matrix  have  replaced  certain  col¬ 
umns  of  the  F  matrix. 

3.3  NUMERICAL  EXAMPLE  -  ROOT  SQUARE  LOCUS 

Consider  the  aircraft  equations  of  motion  given  by: 

A  9  *  Aot  ■*  *  Mfe  AFfg  Pitch  Acceleration 

.  Equation 

•  e 

A9  -Ate  «  Aar  *  Lf  Equation  defining  rate  (3-43) 

of  change  of  flight  path 

T *■  ASe  •  £kSc  Actuator  Dynamics 


In  first-order  form,  with  9  >  of  and  Se  state  variables,  the  equations 
of  motion  become 
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(3-44) 


Using  the  equations  of  motion  typical  of  a  modern,  high-performance  fighter 
aircraft,  these  derivatives  can  be,  for  example, 
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M*  =  -.742  sec"2 
=  -,257  sec-1 
W5|  »  -,267  sec"1 
*  -2.  08  sec"* 

Consider  the  performance  criterion  given  by 


L*  a  .535  sec"1 
=  .  109  sec”1 
T  a  ,  1  sec 


\%**  +  r$tz)dt 


(3-45) 


It  is  desired  to  obtain  the  closed-loop  characteristics  of  the  optimal 
system  that  results  when  the  integral  of  Equation  3-45  is  used  as  a  criterion. 
The  closed-loop  roots  of  the  optimal  system  together  with  the  adjoint  system 
can  be  determined  by  the  root  square  locus 


where 


I  fS"^'  H’QH  [is-Fy'G  *  0 
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(3-46) 
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where  A-jj  is  the  first  minor  obtained  from  |ls  -  F|  by  deleting  the  third  row 
and  first  column  and  .  .  .  _ , 
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Substituting  into  the  root  square  locus  expression  yields 
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The  actual  plot  of  the  locus  of  the  closed-loop  poles  of  the  optimal  sys¬ 
tem  is  shown  in  Figure  3.  Although  the  open-loop  adjoint  poles  and  zeros  are 
shown,  the  locus  of  the  closed-loop  adjoint  system  is  omitted  for  purposes  of 
rlaritv.  Th»  plot  h s.:  beer,  performed  vu  »n  E3IAC  root  locus  plotter,  the 
ordinate  is  phase  angle  (or  damping  ratio)  and  the  abscissa  is  (s|.  The  "fish 
scales”  represent  constant  values  of  the  real  or  the  imaginary  part  of  the 
Laplace  variable  s.  The  parameter  of  the  locus  is  g/r1  ,  the  ratio  of  the 
weighting  factors  of  AoC  and  *  It  can  be  seen  from  the  plot  that  as  g/r 
is  increased  from  zero,  the  poles  of  the  closed-loop  optimal  system  appear 
to  approach  a  damping  ratio  of  t  -  .  707  in  the  limit.  In  fact,  it  can  be  shown 
that  the  excess  poles  over  zeros  of  the  root  square  locus  approach  a  Butter- 
worth  pattern  as  the  %/r  becomes  large  (Reference  3).  It  has  been  found  that 
the  approximation  to  a  Butterworth  is  good  for  even  small  g/f  values. 

The  root  square  locus  plot  Illustrated  in  this  example  supports  the 
intuitive  basis  for  the  selection  of  the  matrices  Q  and  R  in  the  performance 
index.  One  may  select  Q  and  R  to  trade  off  control  deflection  magnitudes  for 
speed  of  response.  The  root  square  locus  plot  demonstrates  that  a  systematic 
change  in  the  selection  of  Q  and  R  results  in  a  gradual,  predictable  change  of 
the  dynamic  characteristics  of  the  system.  Regardless  of  the  values  of  Q  and 
R  chosen,  the  optimal  system  will  tend  to  have  smooth,  well  behaved  transient 
characteristics.  It  is  believed  that  the  dynamic  response  of  a  linear  optimal 
system  frequently  is  characteristic  of  the  type  of  response  that  one  intuitively 
tries  to  attain  when  using  conventional  design  procedures. 

He  also  wishes  to  determine  the  feedback  gains  required  to  obtain  the 
closed-loop  dynamics.  These  feedback  gains  can  be  easily  found.  The  opti¬ 
mal  control  law  is  given  by 

u.t  *  -  rP%  •  -  15% 

and  the  optimal  closed-loop  regulator  becomes 

x  -  (F-<se)% 

whose  characteristic  equation  is 


Irs-F^tfl  -  o 

or,  in  terms  of  the  aerodynamic  derivatives: 


S  * .535 

-1 

.109  " 

m  m 

0 

.59 9  . 

S  f  .524 

2.08 

0 

0 

0 

6*10  _ 

10 

or 


S+.S33 

.599 


S4 .524 


(3-48) 


[*'  *0 


.109 

2.05 


(3-49) 


Locus  Plot  -  Single  Input  Example 


The  expansion  of  Equation  3-49  yields  the  characteristic  equation  for  the 
closed-loop  optimal  system  in  terms  of  the  feedback  gains* 


Expanding,  there  results 

S9*  9 *  (l 1. 06  +  10 ks)  +  9 (it. 4-7  *  10.59  k*  -  20.5  L.  -  t.09  6,) 

+  (8.79  *  8.79  V  10.3 k,  -  21.1  k,)  -  Q  (3_g0) 

From  the  root  locus  plot.  Figure  3,  a  polynomial  of  the  closed-loop  charac¬ 
teristic  equation  can  be  formed.  As  an  example,  if  £/f*  =10  were  chosen, 
it  is  found  from  the  plot  that  the  closed-loop  roots  are  obtained  from  the 
characteristic  equation 

(s+  f0.2)[s*+  2(.69)(Z.S$s  +(2.SS)*]  •  0 
or 

$*+  /3.72S2  +  42.4s  +66.3  •O  (3-51) 


Equating  powers  of  s  of  Equations  3-50  anJ  3-51,  the  feedback  gains 
are  found  to  be  obtained  from  the  solutions  of  the  three  equations: 

11.0b  *  10k9  -  13.72 

11. 47  +  10.39  kj -  20.SU,  -  f-09k,  -  42.4  (3. 

8.79  *  8.79  k9  -  10.3  k9  -  21 1  k,  «  66.3 

Solving  these  equations  yields  the  feedback  gains 


k9  »  0.266 
kt  «  -  1,  263 
It,  *  -2.00 


(3-53) 


The  closed-loop  flow  diagram  is 


Figure  4.  Flow  Diagram  of  Optimal  Regulator 


It  has  been  argued  that  optimal  systems  are  impractical  because  of  the 
multiplicity  of  feedback  gains  required.  However,  it  can  be  easily  seen  that 
because  the  system  is  assumed  to  be  completely  linear,  the  state  variables  are 
related  by  transfer  functions.  For  instance,  can  always  be  reconstructed 

from  with  a  lead-lag  network,  eliminating  the  requirement  for  separate 

Atf  and  Ad  sensors.  Also,  because  parts  of  the  system  are  at  the  de¬ 
signer's  disposal,  the  feedback  can  often  be  incorporated  in  an  altered  design. 
For  instance,  the  feedback  A£e»-.  zledig  simply  represents  a  requirement 
for  an  actuator  with  a  time  constant  different  from  T  *  .  1  seconds. 

The  above  example  is  simple  and  could  have  been  solved  by  conventional 
techniques,  but  the  example  does  show  that  an  optimal  control  approach  gives 
an  orderly  treatment  of  problems.  The  optimal  control  approach  remains 
orderly  for  any  system  complexity. 

3.4  ROOT  SQUARE  LOCUS  -  CONTROL  RATE  IN  THE 

PERFORMANCE  INDEX 

It  was  seen,  from  Equation  3-8,  that  a  variety  of  quadratic  forms  can 
be  used  in  connection  with  the  quadratic  performance  index.  Consider  the 
performance  index  that  contains  not  only  the  square  of  the  control  but  also  the 
square  of  the  control  rftte.  It  has  been  shown  previously  (Reference  2)  that  an 
acceptable  trade-off  between  state  variable  excursions  can  be  obtained  for  the 
optimal  regulator  by  trial  and  error  techniques.  If  the  control  deflections  are 
greater  than  desired,  say,  to  avoid  amplitude  saturation,  it  is  necessary  only 
to  increase  the  relative  values  of  R  appearing  in  the  performance  index.  It  is 
felt  that  the  inclusion  of  a  Cl  quadratic  term  in  the  performance  index  will 
enable  the  control  system  designer  to  influence  the  relative  control  deflection 
rates  of  the  Optimal  solution.  In  addition,  it  will  be  shown  that  this  addition 
produces  the  equivalent  of  an  additional  lag  term  in  the  root  square  locus,  and 
therefore,  in  the  optimal  system  as  well. 

Consider  the  problem  whereby  it  is  desired  to  obtain  a  design  satisfying 
the  performance  index 

w 

2V »  f  (%'HtQtfi6+u,Eu  +  CLrT&)dt 

{  '  (3-54) 

subject  to  the  usual  constraining  equation,  the  original  equations  of  motion  of 
the  system 


it  »  Fx  *  Gu>  y  * 

The  matrices  R  and  T  are  defined  to  be  symmetrical  positive  definite 
matrices  weighting  respectively  the  quadratic  functions  of  the  control  deflection 
and  control  deflection  rates. 

To  obtain  the  Euler- Lagrange  equations  it  is  convenient  to  first  gen¬ 
erate  the  function 

X  -  \ (3-55) 


36 


where  X  is*  as  before*  an  undefined  column  vector  which  is  a  function  of 
time. 


The  Euler -Lagrange  equations  then  become: 


9* 


4-IM)* 

Hrf  \  du>/ 


Performing  the  indicated  operations  yields: 


J&L  -J.  +  d’QU^+F'X  a 

*X  - 


(3-56) 

-|£  =  ±  {#«  *  *u)+  a’l  =  +  a'% 

•|£  *  +  (r'&*Ta)-n 


Combining  the  Euler -Lagrange  equations  with  the  constraining  equa¬ 
tion  yields: 


-  &  t  Fit  *  Cu>  •  0 


U’QHH-  +  i*FfX  •  0  (3-57) 

-TU  +  d'X  *£*  *0 

The  multivariable  root  square  locus  expression  is  de sir ed  for  the 
variational  set  of  equations  (3-57).  To  find  the  expression  for  the  character¬ 
istic  equation  of  the  above  set  of  equations,  first  take  the  Laplace  transform 
and  obtain: 


frs-F]  0 

-s 

%(0) 

-H'QH 

0 

uo 

m 

-X(o) 

o  - rmfa 1 

♦  rsf-r*/«_ 

u(i) 

w  mm 

-  su(o)-&(o)_ 

The  determinant  associated  with  the  matrix  set  of  equations  (3-58)* 
when  set  equal  to  aero*  defines  the  characteristic  polynomial  of  the  optimal  . 
system*  which  includes  the  stable  solution  and  the  adjoint*  or  image  solution. 
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It  will  be  convenient  to  use  Gauss'  Algorithm  to  find  an  equivalent 
expression  to  the  determinant  of  Equation  3-58.  This  determinant  is  of  the 
partitioned  form 

On  0  Ota 

C$1  0»s  0  -  0 

0  C9i  C53 

where  Cjj  is  a  submatrix  within,  the  determinant  of  a  partitioned  matrix* 
The  following  transformation  does  not  alter  the  value  of  the  determinant  if 
Cjj  is  square  and  Cjj  4  0. 


0 

% 

0 

Zzz 

0 

■ 

0 

/>  w 

”, u 

A  f* 

°*3 

where 

0 

C52 

0 

A  » 

°»» 

A  W 

L*/» 

•  - 

'ft,  - 

**0 

In  terms  of  the  matrices  of  the  determinant  of  Equation  3-58  the  re¬ 
sult  is 


[is-r] 

» 

0  -<5  ft 

lis-r  J 

0 

-G 

-H'QH 

-[u.r'J  0  *  j 

0 

wqh[u+Y& 

V 

-r'<?  +isl-Tm,ie 

0 

-r'fl’ 

is3-  7"'£ 

Repeating  the  Algorithm: 


0 

ft 

0 

ft 

0 

A  <0 

ft"’ 

£ 

0 

m 

ft." 

0 

a  0) 

ft." 

0 

0 

ft," 

where  Ci#W-  -  0U  M  *'  Ctt ♦  C„  t0 


Equation  3-59  finally  becomes 


[x.-p]  0 

-fl 

[i.-r] 

0 

-G 

0  » 

-MW  [-I.-F'] 

0 

m 

0 

[-I.-F0 

0  -T*'c' 

I•**r*,* 

0 

0 

(rfa'faFf]m,uw[T9-r]‘'  a 
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aySyfriijirfSiVi 


which  can  be  written  as  follows: 

\r%-F\l-U-F’,\\[U*-T',2)*T-,G'[’Is-F,Y,H'M[Zs-rTlG\  -  0  (3-60) 

Because  |Is  -  F(  and  | -Is  -  F'|  are  by  definition  square  and  not  equal  to 
zero  except  at  th«  nr»*n-l<y>p  roots,  it  is  necessary  tc  consider  only 

or  •  \[U*-r,B]*T’tQ,[-Is-F>r'H'Qtf[Xv-FY1Gl  -o 

jl*  [lsi-T-ilsrfr-i(;,[-IS’F,]'iUfff^[ls-F]'fGI  •  0  (3’6l) 

to  obtain  the  closed-loop  roots  of  the  optimal  system  and  its  adjoint.  Notice 
also  that  for  this  performance  index*  jTta-T~fJSl  defines  additional  open-loop 
roots* 


It  can  be  seen  that  the  Cl'Tu  additions  to  the  performance  index  produce 
a  slightly  different  expression  for  the  root  square  locus*  with  fls,-T”/ff  ]~f  T-' 
replacing  Rm(  .  This  has  the  effect  of  adding  additional  poles  in  the  root  square 
locus  plot  at  the  values  indicated  by  the  expression  ,  The  effect  on 

the  optimal  closed-loop  system  is  to  add  first-order  lag  networks*  one  for  each 
input  or  controller. 


3.5  ROOT  SQUARE  LOCUS  -  OUTPUT  RATES  IN  THE 
PERFORMANCE  INDEX 

Consider  the  performance  index  containing  only  the  output  rates  and  the 
control  deflections  in  the  performance  index*  i.e.  • 


2V  *  /(Q’My*  u'Vti)dt 


(3-62) 


where  M  and  R  are  defined  as  positive  definite  symmetrical  matrices  weighting 
the  individual  terms  of  the  performance  index.  The  constraint  is*  as  usual* 
the  equations  of  motion  ' 

i  •  F%  +  <2<*  (a) 

u  /Uv  (3-63) 

<j  *  Hx  (b) 

Substituting  for  y  in  Equation  3-62  yields 

2V  *  + 

0 

The  Euler  equations  associated  with  the  solution  of  this  problem  are*  as  before* 


9* 

9+ 


£X 

9u 


d  (  dX\ 


where 


(£  «  •£  %'•(-&  +  rv  +  tSu) 


(3-64) 


The  Euler  equations  yield 

&  ♦  F' %  *  0  (a) 

*  G  *  X  “  0 ,  hence  X  (b) 


(3-65) 
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-  v-v1'* 

.  .  fl',  /.?#.*!  .  *  » 


Combining  Equations  3-63a  and  3-65,  the  result  is,  after  taking  a 
Laplace  transform 


[is-F]  <Sr'<2'  v(»)  *(0) 

[•Is]#’AfH[ls]  f-Is-F']  Z(s)  -H'MH  [is  *  (0)4  x(0)]  +  [A  (o)] 


i3-bt» 


The  determinant  of  Equation  3-66,  when  set  equal  to  zero,  defines  the  roots 
of  the  closed-loop  optimal  system  and  its  adjoint. 

Again,  by  using  Gauss'  Algorithm,  it  can  be  shown  that  the  root  square 
locus  becomes: 


1 1  ♦  [-I$]V,[ls]G'[-It-F’y,d’M[ls-F]'/<S  |  -  0 


(3-67) 


It  is  clear  from  Equation  3-67  that  zeros  are  added  to  the  root  square 
locus  plot  at  the  origin*  Otherwise,  the  expression  is  the  same  as  Equation 
3-25.  Adding  zeros  at  the  origin  of  a  root  locus  plot  is  equivalent  to  obtaining 
the  locus  of  the  derivative  of  a  transfer  function.  Equation  3-67  can  then  be 

I  t-silMf-?  (5)1 1-0 


i . f-i.Je-'fi.J  [-£ m,]  <s>]  |  -o 

X  *  [-  Is]  Z'^ls]  Wf  (s)  MW(s)  |  •  0 


I*  IS' 


y  f 

— f-sj  N 

1  f-f  (8) 

U  J 

lu  J 

(3-68) 


The  Riccati  equation  can  be  easily  obtained  for  this  particular  per¬ 
formance  index  by  substituting  it  •  F%*Su>  in  Equation  3-64  before  the  Euler 
equations  are  obtained.  The  function  becomes 

X  -  ^  {(it'F'+u’G'jlli'MHjfFiti-Guj+u'Bu}*  Xf,(-i  +  Fit  +  Gu) 

■  Y  ♦  j  x'F'bl'MUGu  *  ~  h’G'U'MHF* 

+  j  a' (G WMHG +0)u*l'‘(-ji*Fic+Gu) 

flv 0  py 

—  .  F'U'MUF*  4  FWMUau  +  F'%  -  -  % 

—  -  G'F'MHF*  *  [G'H’MHG  ♦) ?]U4G’JI  -TT-  -  0 
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The  Euler -Lagrange  equations*  together  with  the  constraining  equation*  become: 

X+r'l+  F’U'MFFx  *  F’H'MUG*  «  0  (a) 

G'H'MUFx  *  fff  'H*MUG  *  1?]u  +  G*A  •  0  <b) 

Ik  «  rik  -  £  a  m  0  {  c  } 

Solving  Equation  3 -69b  for  u  yields  the  optimal  control  law 
aa  “  -  [Cti'/WG  *  12 ]'f[6'A  +  G'H*MHF%\ 

Now  substitute  3-70  into  3-69a  and  3-69c  and  obtain 
% -f%* +  C’U'MHF*)  * 0 

A  *GWM#F*}»0  (b) 

Let  A  ■  Px  *  i  •  P%  ,  where  P  is  a  constant  matrix*  and  multiply  3-71a  by  P, 
yielding: 

P*  -  PF%  ♦  VG[WHM * VplG'  Px  *  GWMFFt]  -  0 

P%  +F'P*  t  PWtfHFx  -FWMMjjSWMMl  *  «J‘  '[S'P*  +GWMHF* ]•€> 

Finally,  eliminating  PA  in  the  above  equations  yields  the  Riccati  equation 

p[F-GAm,8]+[F'-B'A-fG']P*[C-B'4'fS]‘P6A‘'G'P*0  <3-72) 

where 

A  =  G'H'  MHG  +  R 
B  *  G'H'  MHF 
C  -  F'H'MHF 


3. 6  ROOT  SQUARE  LOCUS  -  MODEL  IN  THE  PERFORMANCE  INDEX 

The  use  of  a  mathematical  model  appearing  only  in  the  performance 
index  to  describe  a  desired  system  matrix  was  first  suggested  by  Kalman. 

The  technique  is  as  follows.  A  mathematical  model  is  defined 

(3-73) 

where  %  is  some  fictitious  state  variable  and  L  is  the  system  matrix  of  the 
desired  system.  A  performance  index  is  specified  of  the  form 

60 

2Vm  J([4-Ly'l,Q[$-Ly]+u'Bu)dt  (3-74) 

0 

It  can  be  seen  that  if  the  system  output  rate  y  behaves  exactly  as  the 
model*  the  first  term  in  the  performance  index*  $  -  Uy  *  will  be  sero.  If  the 
control  of  the  system  is  such  that  feedback  can  force  the  system  to  behave 
exactly  as  the  model*  the  regulator  in  the  limit  (i.e.,  as  <*  )  will 


(3-69) 


(3-70) 


(a) 


(3-711 
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b*h»v*  exactly  a*  the  modal.  To  obtain  this  condition,  if  it  is  possible,  one 
need  only  consider  the  performance  index 


A*  f 


fr, 

J  ** 

0 


/  r.\ _  / 


4  *%  % 


If  the  model  can  be  exactly  matched,  an  optimal  solution  will  simplify 
such  that  the  optimal  feedback  control  law  becomes  a  set  of  fixed  feedback 
gains.  It  should  be  pointed  out.  however,  that  the  case  where  the  system  and 
the  model  are  exactly  matchable  is  the  rare  exception  rather  than  the  rule. 

In  general,  it  requires  that  L.  F  and  G  be  of  the  same  dimension.  An  artificial 
procedure  would  be  to  have  the  number  of  columns  of  the  G  matrix  equal  to 
the  number  of  non-matching  rows  of  F  and  L.  For  instance,  if  F  and  L  were 
each  obtained  from  a  transfer  function,  then  F  and  L  can  be  written  such  that 
only  the  entries  in  the  last  row  of  F  and  L  differ.  In  this  case,  a  single  con¬ 
trol  variable,  with  a  column  G  matrix,  may  be  sufficient  to  exactly  match 
the  optimal  regulator  to  the  model.  However,  exact  model  matching  in  prac¬ 
tice  often  requires  large  or  violent  controller  motions.  The  inclusion  of  the 
term  in  the  performance  index  allows  as  close  a  match  as  possible 
within  allowable  controller  motions. 

The  root  square  locus  for  the  model  technique  is  obtained  in  a  manner 
very  similar  to  the  previous  developments.  The  performance  index  is 

.  oo 


f  ([j-LyyQ[t}-Ly]  +  u'12u)rt 


where 


y 

$ 


Hi 


Substituting  for  y  and  y  yields 
00 

2V=  Jfti'H’-vWL'jQ  [h/i-  LHy>]  +  u'13u)M 


00 


To  assure  that  the  integral  performance  index  contains  quadratic  forms, 
note  that  the  two  bilateral  forms and  constitute  the 

symmetrical  part  of  -2%’  H'QLHx  and  therefore  can  be  treated  as  a  quadratic 
form. 


As  before,  the  Euler -Lagrange  equations  are 

BX  d  tQX\  Q  ax  d  l_9X\ 

dy,  ~  dt  Su  dt  \9il)  " 
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where 


+  A'-  {-  v  *  P%  +  Gu) 


The  Euier  equations  become: 

i  +  F'X- U'QH*  +  H'QLte -  H'L 'GA/V  - &L 'QLU'y.  = G  (a) 

ntn-CX  - 0  (b) 


(3-77) 


Solving  Equation  3 -77b  for  u  yields  the  optimal  control  law 

u.0~-V“fG'X 

The  two  equations  that  describe  the  realizable  optimal  system  and  its 
adjoint  are: 


x-rv+Gft-’G'l  = o 
i  +pf  l-tf'Qtfje  *  U'QL/H-V'L  fQA/y  * 


(3-78) 


In  Laplace  transform  form*  these  equations  become 


[is-r] 

gf'g' 

1(tl 

*(o) 

s 

+H'QH  [is  x(o)+%(o)]~  U'[QL  *L'«i]d%(o)-\(0) 

The  determinant  of  the  left-hand  side  of  Equation  3-79,  when  set  to  zero,  de¬ 
scribes  the  closed-loop  poles  of  the  optimal  system  and  its  adjoint.  Using 
Gauss'  Algorithm,  as  was  done  previously  in  this  section,  a  convenient  ex¬ 
pression  for  a  root  square  locus  can  be  obtained: 

\r+Te’,a'[-Is-F']'f^,[-Is-L']9[ls-L]tf[l?-F‘]',Gl=0  (3-80) 


which  again  is  of  the  general  form 


I  +IC 


DT5 


It  can  be  seen  from  Equation  3-80  that  the  elements  of  the  model  ma¬ 
trix  appear  in  the  root  square  locus  and  contribute  to  the  zeros  of  the  root 
square  locus.  In  fact,  the  order  of  the  numerator  Nfi  is  generally  increased, 
such  that  Nft  and  DC  can  be  of  the  same  order. 


If  this  is  the  case,  the  elements  of  the  Q  matrix  can  be  chosen  such  that 
the  zeros  of  the  root  square  locus  are  the  eigenvalues  of  the  model  and  ad¬ 
joint,  i.  e.,  |  Is  -  L|  and  |- Is  -  L' j  and  the  optimal  system  will,  in  the  limit, 
(ae.,  as  l9l/jBf  becomes  large)  have  closed-loop  poles  that  are  identical  to 
the  model  poles.  However,  this  procedure  would  in  general  require  some 
negative  values  for  the  elements  of  the  Q  matrix.  The  system  can  no  longer 
be  described  as  "optimal"  as  defined  in  the  original  formulation  of  the  problem. 
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However,  if  on*  obtains  better  model  following  by  selecting  negative  q  ele¬ 
ments*  the  distinction  be  tween 'optimal*  and  'non -optimal*  be  comes  trivial. 

3.  7  MODEL  AND  PLANT  EXACTLY  MATCHABLE 

It  is  not  obvious  in  the  previous  formulation  of  the  model  performance 
index  problem  that  the  plant  will,  under  certain  circumstances*  actually  match 
the  model  exactly*  A  slightly  different  formulation  of  the  problem  will  show 
the  match  more  clearly. 

Starting  with  the  same  performance  index 

id 

0 

Substitute  for  y  and  y 

y  »  the 

y  » 

and  obtain 

00 

Z\J  »  J ([HFx  +UGu-Ut%yQ[HFx  +  UGu- Lti%']*u'13u)dt 

0 

00 

=  J  (x'[tlF-UfyQ[ur-LH]%  +  %'[UF-LHy0H<Su 

0 

+  u,G,H,QfrF-Ltf]x+u'[aWQM*v]u)ctt  (3_81) 

This  performance  index  is  of  the  quadratic  form 

ZV  *  J  (x'A x  r  V-1 8u  v  ll’B'v  *■  u*Cu)dt 
o 

where 

A  ~[dF-LLl]'Q[HF-LH] 

B  ■  [MF-LtiyQMG 


The  Euler -Lagrange  equations  are  obtained  in  the  same  way  as  before* 
using  the  function 

aC  »  ’zfx' Ax  +  *■'&(*  +  a* Bf%*ufCu)*  £(-&  +  Fv  +(Su) 

The  Euler  equations  are: 

V  +  F’X  +  Bu+Ay.  - 0 

3'%  +  - O 


(a) 

(b) 


(3-82) 
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Solving  Equation  3- 71b, 


y*  -  /  mm*  s*  9  * 

- U  (7  W  A 


(3-83) 


The  two  equations  that  describe  the  closed-loop  optimal  system  and  ita 
adjoint  are  Equations  3-82a  and  the  original  plant  equation*  with  ut  substituted 
for  a  . 


%-F«  +GC-f8' %  +GC’f6!fl  -  0 
b  +  FH*A%-8C,3,*-8C'tGfX  • 0 


After  writing  these  equations  in  Laplace  transformed  matrix  form* 
there  results: 


[ls-F*GC'f8f] 

GC’fG* 

Ws) 

-A+BC-'B' 

-[ls*F’-BC-fG') 

Us) 

m 

(3-85) 


It  will  be  recalled  it  was  stated  that  if  the  plant  and  the  model  can  be 
exactly  matched*  the  dimension  of  F  and  L  must  be  the  same*  and  that*  in 
general*  the  number  of  columns  of  G  must  equal  the  number  of  rows  of  F  and 
L.  Also*  the  term  in  the  performance  index  can  be  dropped.  There¬ 

fore*  let  R  -  0,  H  ■  1  and  dim.  F  -  dim.  L.  Then  HG  is  invertible  and  the 
matrix  entries  in  Equation  3-85  become: 

Is-r+Gfr'S'  - 

-  Is-F*  <*[G,QG)'fG,Q[F-L') 

*  Is- L 


•[Xs+F'-BC-’G']  -  - [rs  +Ff-  [uf-lu]'qhg [G ,F^UG]',G'] 
-  -  Is- L' 


A-BC-*?'  =  0 
GC'< G'  *  I 


Substituting  these  values  into  Equation  3-74*  there  results 


Is-L 

0 


I 

-Io-Lf 


*(*) 

Us) 


(3-86) 


The  determinant  of  this  set  of  equations*  when  set  equal  to  aero*  is 

Ils-L  II-Ib-  L'l  *  0 

Therefore*  the  optimal  regulator  has  exactly  the  same  characteristic  equation 
as  the  model.  The  optimal  regulator  satisfies  the  set  of  equations 

and  the  model  dynamic  characteristics  have  been  exactly  matched.  Under  these 
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circumstance*,  the  optimal  feedback  control  law  i*  given  by 


u0  -  -  C"'V*  -  -[i F-LJX 


U-07) 


When  the  plant  and  the  model  are  exactly  matchable.  optimal  techniques 
are  obviously  not  required  to  obtain  the  feedback  law  which  produces  the  match. 
The  importance  of  this  technique  lies  in  the  fact  that  if  the  feedback  gain  mag¬ 
nitudes  were  restricted,  linear  optimal  techniques  will  enable  the  designer  to 
match  the  model  as  closely  as  possible  in  the  integral  error  squared  sense 
within  the  allowable  control  motions.  It  has  been  repeatedly  demonstrated  that 
a  near  match  in  this  manner  produces  a  well  behaved,  smooth  approximation 
to  the  desired  model  system  matrix. 

Two  examples  will  serve  to  demonstrate  the  model-in-the-performance 
index  technique  under  the  circumstances  when  the  plant  and  model  are  match- 
able  and  not  matchable. 


Example  1:  Model  and  Plant  Matchable 

Let  the  system  be  described  by  the  first-order  set  of  differential 
equations 


(3-88) 


and  let  the  model  be  described  by  the  fictitious  set  of  first-order  linear 
equations 


hi 

ht 


(3-89) 


Notice  that  the  plant  and  the  model  vector  describe  an  orthogonal  set 
and  the  matrices  differ  in  only  one  row.  There  is  one  controller,  so  it  can 
be  hypothesized  that  these  sets  of  equations  can  be  exactly  matched  as  |Q|/|f8| 
becomes  large. 


Equation  3-80  is  the  expression  for  the  root  square  locus  for  this 
problem. 

|i+r^/frs-rTVfis-/.']pfrs-Lj^/is-rj-/G|  -o  (3-90) 
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It  has  been  shown  previously  that  the  ratio  /®///8/  is  the  main  par¬ 
ameter  of  the  root  sonar*  locus  plot  rather  tk the  Absolute  values  ot  u  or 
R.  For  convenience,  then,  for  this  example  choose 

and  £  =  |~r] 

Of' 

Calculating  the  entries  in  the  root  square  locus  expression: 

M[ls-  -  the  generalized  transfer  function  matrix 


o~ 

0 " 

/ 

_0 

1  _ 

I 

1 

a* 

I _ 

A'- 

zyfW 

hi 


VF(t) 


1 

S 


uthere  DF  (s)  **  s*+  sf ?g  *  ?it 


Similarly, 

-  -111—  [  /  .5]  VF(-s)  -  5z-hi  s  *  hf 


[Zs+L’]Q[I9-L] 


9* 


Stt(s*St%) 
1*  (s~^u)(~ 

Substituting  into  the  root  square  locus  expression  yields 


-s*Stf  (’S+Iu) 


-9+St1*  9+S„(i+it%) 

1.  „ r, [r 

0F(t)Vp(-  s)  k  J 

s+ht)  f+  (s-*tt)(~3’hi)_ 

_s_ 

or 


or 


/r  Al  {•*+*tt****i){**-*n*  +  itf) 
r  Vf(9)Df(-s) 


«  0 


i  + 


9 11 1  Vl  (•>  £4  M 


W  0 


where 


r  (-*) 

VL  (s)  -  st*Jus*Stf  t  Dl  (-9)  •  9  *  *tt 


(3-91) 
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Because  the  zeros  of  the  root  square  locus  ~L  ( r)  anu  DL  (- s)  <n  c  ih« 
characteristic  roots  of  the  model  and  its  adjoint,  the  root  square  locus  will 
originate  at  the  poles  of  the  plant  and  terminate  at  the  model  roots*  The  op¬ 
timal  regulator  and  the  model  will  be  identical  as  f/r  approaches  infinity. 
The  feedback  gains  will,  of  course,  be  finite. 


To  provide  an  actual  numerical  example,  let 


"  o  r 

0  1  ' 

~  o' 

1  0 

F  • 

L  * 

a  « 

Q  - 

-1  -2_ 

-25  - 7.07 

1  _ 

_0 

The  expression  for  the  root  square  locus  becomes 

r-(  (s*  +  7.07S  *  2&)(s*- 7.07s  *  25) 
1  +  (sa  +  IsTtJJs* -2s  *  f ) 


Figure  5  is  a  root  square  locus  plot  performed  on  an  ES1AC  root  locus  plotter, 
which  semiautomatically  obtains  a  root  locus  on  a  rectangular  plot,  with  damp¬ 
ing  ratio  or  phase  angle  of  s  as  the  ordinate  and  absolute  value  of  s  as  the 
abscissa. 

The  parameter  of  the  locus  is  ifr  and  the  plot  shows  that  the  plant 
poles  migrate  to  the  model  poles  rapidly  and  in  an  orderly  fashion. 

The  optimal  control  law,  in  the  limit  as  ys*  -*>  oo  is 


U „ 


or 


u. 


-  fr-L)x 


~24v,  -  £.07 %t 


*  This  example  was  used  previously  by  Tyler,  Reference  12. 
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I? _ ..1  .  if  .  .1.1  .  i  r»t  <  .  «  «  *  .  t  i  ?  »  a*  «« 

fa»  mvuci  anu  *~iani  Ottunui  oc  mttjUlcu  menutau] 

As  a  second  example  of  the  use  of  a  model  associated  with  optimal 
control,  it  was  decided  to  use  a  somewhat  more  realistic  system.  The  simp- 
lified  equations  of  longitudinal  motion  of  a  high-performance  military  fighter 
aircraft  were  hypothesized  for  the  plant.  A  model  system  matrix  was  specified 
whose  natural  frequency  and  damping  are  such  to  satisfy  acceptable  flying  qual¬ 
ities.  Natural  frequency  and  damping  are,  of  course,  only  two  parameters  of 
many  that  are  used  to  define  acceptable  flying  qualities.  Other  parameters, 
such  as  the  slope  of  Cl  vs.  cC  curve  are  equally  important. 

However,  the  model-performance  index  problem  as  it  is  presently 
formulated  allows  only  for  a  change  in  the  system  matrix,  i.e. ,  it  is  possible 
to  change  only  the  state  transition  matrix.  The  transfer  function  matrix  is 
made  up  of  the  output  matrix  and  the  control  matrix  as  well,  so  the  transfer 
function  of  the  closed-loop  optimal  system  can  be  affected  only  to  a  limited 
degree. 


If  the  above  logic  is  extended  to  the  model  situation,  it  should  be  noted 
that  the  performance  index  for  the  model  case  is  specified  in  terms  of  error 
rates  between  a  desired  response  and  an  actual  response.  Since  whatever  ap¬ 
pears  in  the  performance  index  approaches  a  Butterworth  response,  it  is  clear 
that  the  error  rates  between  the  model  and  the  aircraft  will  be  smooth  and  well 
behaved,  approaching  zero  as  the  weighting  on  the  error  is  made  very  large 
with  respect  to  the  control. 

It  is  not  possible  in  this  case  to  exactly  match  the  plant  to  the  model 
with  finite  values  of  error  and  control  weighting.  Assuming  that  the  important 
variables  are  angle  of  attack  and  pitch  rate,  it  will  be  instructive  to  see  how 
the  closed-loop  roots  of  the  optimal  regulator  behave  as  a  function  of  the  rel¬ 
ative  weighting  of  the  A  6  and  A  OC  error  rates  and  the  ratio  of  the  error 
rates  and  the  control  deflections. 

Assuming  straight  and  level  flight,  the  short  period  equations  of  motion 
about  the  stability  axes  can  be  written: 

(a) 

<b,(3-93) 

The  elevator  actuator  dynamics  were  assumed  to  be 

t>St  -  aSe-u>;cT&h  *a>*cr  hSc 


r  •  •  m  j*  pitching  acceleration 

AQ  -  M^Acc  +  M&A9  da?  +  equatio„ 

A6-A&  *  Aoc  *  Lge  ASe 


flight  path  velocity 
equation 


These  equations  of  motion  are  easily  put  into  first-order  form  by 
solving  for  Aoc  and  substituting  for  Aoc  in  the  pitching  acceleration  equation, 
Equation  3-93b. 

In  matrix  form,  the  first-order  differential  equations  of  motion  become 
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mii  . --naana, 


Ak 

-4* 

f  -LU 

o 

l 

■a 

l_ 

0 

A  9 

Hr"**'* 

0 

0 

m 

s 

ASe 

0 

0  0 

1 

Me 

0 

0 

0 

^Acr 

-***>4cr 

i 

ASt 

w»tir 

The  model  chosen  is  of  the  form 


4 


(3-94) 


% 

3 

i 

l _ 

1 

* 

i _ 

and  the  following  derivatives  have  been  chosen: 


* 

-. 742  sec”2 

fl 

-16. 0  sec"^ 

s 

-. 257  sec"* 

II 

s 

-2. 9  sec"* 

Mk 

= 

-. 267  sec"* 

II 

£ 

-1, 0  sec"* 

% 

* 

-2. 08  sec”2 

II 

i 

1. 5  sec"* 

A a 

= 

. 535  sec"* 

^/ter  = 

20. 0  rad/sec 

Lh 

- 

. 109  sec”* 

%*cr  = 

1.0 

The  flight  condition  associated  with  the  derivatives  listed  above  is  one 
of  low  speed,  low  altitude  power  approach.  The  short  period  natural  frequency 
is  0.935  rad/sec  and  the  short  period  damping  ratio  is  .505.  The  model  has 
a  short  period  natural  frequency  of  4.5  rad/sec  and  a  damping  ratio  of  0.6. 


Substituting  the  aerodynamic  derivatives  into  Equations  3-94  and  3-95 
yields,  for  the  F,  L  and  G  matrices: 


"  -.535 

1 

-.109 

0  ' 

0  ' 

-.599 

-.529 

-2.05 

0 

0 

0 

0 

0 

1 

Q  * 

0 

0 

0 

-400 

-40  _ 

_4oo  _ 

r -i.s 

/  n 

y+s 

-3.9  _ 

(3-96) 
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It  is  clear  that  the  closed-loop  optimal  regulator  i  ■  (F-OfX)x  cannot 
be  forced  to  have  the  dynamics  of  the  model  under  any  circumstances.  The 
aircraft  and  the  model  matrices  are  of  different  order,  and  even  if  L  were 
written  as 


•US 

1 

0 

0 

* 

1 

0 

— 

-f4S 

-3.9 

0 

0 

ht 

0 

0 

0 

0 

0 

0 

- 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

to  make  the  two  matrices  of  the  same  size,  all  four  rows  of  F  and  L  are  dif¬ 
ferent,  and  as  has  been  suggested  previously,  at  most,  one  non-identical  row 
of  F  and  L  can  be  matched  with  one  control  variable. 

It  will  be  instructive,  nevertheless,  to  investigate  the  closed-loop  dy¬ 
namics  of  the  optimal  system  that  match  the  model  as  closely  as  possible 
using  the  quadratic  performance  index  as  a  criterion.  It  will  be  seen  that  the 
closed-loop  poles  originally  associated  with  the  actuator  increase  in  frequency 
and  approach  X  -  *  “07  while  the  poles  originally  associated  with  the  short 
period  roots  of  the  aircraft  tend  toward  some  frequency  and  damping  inter¬ 
mediate  between  the  frequency  and  damping  of  the  open-loop  aircraft  and  the 
model. 


Let  it  be  assumed  that  it  is,  nominally  desirable  to  match  the  closed- 
loop  aircraft  to  both  &cCm  and  .  The  following  H,  Q  and  R  matrices  can 

then  be  chosen: 


1  0  0  0  ~ 

l — 

o 

1 _ 

hi  » 

Q  = 

o 

o 

o 

1 

t* 

o* 

o 
_ 1 

This  yields  a  performance  index 

<30 

zv  -  /([t-Lyfylij-Ltjl  +  u'Qu)# 

o 

°r  * 

2V  *  ffo, (&-£„*- 4 qz iu  B) rS<*]dt 

0  (3-97) 


It  has  been  suggested  that  the  matrix  H  must  be  the  identity  matrix  [I] 
for  a  proper  formulation  of  the  model-in-the-performance-index  problem. 
This  requirement  doesn't  appear  to  be  necessary  in  this  case,  for  this  would 
merely  add  two  additional  terms  to  the  performance  index,  mainly, 

There  seems  to  be  no  apparent  advantage  to  the  inclusion  of  these  two  terms 
in  the  performance  index  of  this  problem. 
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■■  - 11  ■  v- ■* - — j-«TS7*rnre^-»"- -  -  — tiF/fiii.  a?  -.t-  •"  " 


f.  Returning  to  the  problem  with  the  performance  index  of  Equation  3-97 
the  expression  for  the  root  square  locus  is,  as  before  4  ‘ 

\l+  %'l<i'[-l9~F,Y,H,[-ja-L,]Q[i9-L]H[l$-rJ1Gl «  0 

From  the  definition  of  Hfls-Fl’k  and  G'F-I*- r'V'tf'  tk*  _ * 

tion  matrix  and  the  transpose  of  the  matrix  with  s  replaced  by  -s,  there  results 


Hfrs-FY'G  • 


c'l-is-r'Y'u' 


.  1* 

•*>) 

Of  It) 

_*i  (Ti  **/;_ 

.  “'icr 

Dr(-s) 

[*« 

^9  (~  S+  l) J 


(3-98) 


where  t^(Z^s+l)  =  numerator  of  “ftfc  (s)  transfer  function  =  A lu 

(fys+l)  *  numerator  of  ^  (9)  transfer  function  =  A/^ 

5+  ')  s  numerator  of  %  (-#)  transfer  function  =  N* 

S*  f)  *  numerator  of  transfer  function  *  Nq 

In  terras  of  the  Aerodynamic  derivatives! 

-  -*n  .-t.03 

*>  -  Lj$m 

«  W»e  *  Mi  W4  *  <w®«8  7i  ‘  T%  L*-\  L,t  *  *•<«  *» 


(*)  =  denominator  of  the  transfer  functione  of  the  aircraft 

.  (»,**&* T’*a>,ic,)(*,<-2fo>»f  *«>„•) 

actuator  aircraft 

Dp  ( -s )  s  denominator  of  the  transfer  functions  of  the  airplane 
with  s  replaced  by  -s  H 

*  (**’  2&>mr**«>„l)(s*-  2?*)ns  +  vS) 
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Also, 


Ms 


*h  ^*K) 


j'  jL 

“  r* 


^wj  (3-99) 


Substituting  Equations  3-98  and  3-99  into  the  expression  for  the  root  square 
locus,  there  results 

.  (fr^cr)  4}/  *^qNq  Ju]  _  ^  (3-100) 

r  ft)  vF(-*) 

Equation  3-100  shows  that  the  expression  for  the  root  square  locus  is 
of  the  form 

,  KNN 


The  zeros  of  the  locus,  NN,  are  a  function  of  qf  and  ?a  and  there¬ 
fore  in  themselves  constitute  a  root  square  locus  expression,  which  is  given  by 


Ng  Ng  /'  r  Ng  Nu  Jf,x  f  Nq  Nq  Itt  -  0 


(3-101) 


After  substituting  for  -I  #  ,  -lit  ,  -f«  and  -tn  and  rearranging  to  ob¬ 
tain  /fj  as  the  parameter  of  the  locus,  there  results 

0ml4il  N*  til* ** 

ii  (s+*tt)*R*  ^6  ^tt  f  )*Mi (“9** *ttl) 

Equation  3-102  defines  the  zeros  of  the  root  square  locus,  that  is,  the 
roots  at  which  the  closed-loop  poles  of  the  optimal  system  will  terminate. 

After  substituting  for  the  numerical  values  of  Ng  ,  A/*  ,  Ng  ,  Ng  , 
Jtt  ,  A v  i  and  Jat  ,  Equation  3-102  becomes 


-3 94  - 


9,  (s  *  /.02SS  *J4.SA>) 

(si  TS32,  7j  S3J7) 


(3-103) 


The  dotted  lines  of  Figure  6  show  half  of  the  locus  of  Equation  3-102 
as  a  function  of  9»  /?*  •  The  reflected,  or  adjoint,  part  of  the  locus  has  been 
omitted  for  clarity.  As  can  be  seen  by  the  figure,  this  locus  defines  the  end 
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points  of  the  locus  of  the  poles  of  the  closed-loop  optimal  system.  The  point 
marlrorl  4.  /4j  art  {•  the  point  thnt  would  htvs  1»«U  obwiiivu  if  iiic  term 
(«  -  Jtt  u-if»  &  )*  had  been  omitted  from  the  performance  index*  while  the 
point  9t  !  9tm  m  is  the  end  point  that  would  have  been  obtained  if  the  term 
( 0  -  ,tfg  tt  -  Mu  d  )*  were  omitted  from  the  performance  index. 


The  locus  of  the  poles  of  the  optimal  system  can  be  found  once  a  value 
of  9</f*  has  been  selected.  If  a  value  of  *100  were  chosen*  Equation 

3-100  can  then  be  used  to  find  an  expression  from  which  the  closed-loop  poles 
can  be  found.  Substituting  q.  ••Off,  and  the  values  for  V#  *  A?*  •  ,  H4  , 

D(s)  and  D(-s)  into  Equation  §-100  yields 


-.OOQ114 


%  [«*  ±  %  (.S6)(+  f9)s  ♦  (4. 19) *  ] 

r  [s  1 20]2  [s*j»  z(.sos)(.9sajs  +  (.935)*) 


(3-104) 


The  locus  of  the  roots  of  the  optimal  system*  given  by  Equation  3-104* 
is  shown  as  the  solid  lines  in  Figure  6  as  a  function  of  the  ratio  qf  /r* .  Again* 
the  adjoint  system  is  omitted  for  clarity. 

The  original  intent*  of  course*  was  to  match  the  system  to  the  model 
as  closely  as  possible.  Because  the  model  was  second  order  and  the  aircraft 
was  assumed  to  be  of  fourth  order*  it  was  known  at  the  start  that  it  would  not 
be  possible  to  produce  an  exact  match.  The  model  has  a  natural  frequency  of 
4. 5  rad/sec  and  a  damping  ratio  of  t  *  0, 6.  It  can  be  seen  from  Figure  6 
that  if  9t  *  0*  two  of  the  closed-loop  roots  will  in  the  limit  have  approx¬ 
imately  the  same  damping  ratio*  t  *  0*6  as  the  model*  but  the  frequency  will 
be  less  than  that  of  the  model.  If  *  00  •  the  natural  frequency  of  two  of 

the  closed-loop  roots  will  approximately  match  the  natural  frequency  of  the 
model*  but  the  damping  ratio  will  not  match.  In  either  case*  the  two  excess 
poles*  originally  associated  with  the  actuator*  tend  toward  a  damping  ratio  of 
approximately  0.  7. 

This  example  attempts  to  answer  the  question  "If  the  model  roots  cannot 
be  matched  exactly*  how  close  can  they  be  matched?"  The  answer*  as  dem¬ 
onstrated  by  the  root  square  locus  plot*  is  that  they  can  be  matched  fairly  well 
depending  upon  how  the  individual  errors  are  weighted  and  how  much  control 
effort  is  allowed.  If  the  available  control  effort  is  limited*  i.e.*  if  q,  / i* 
is  finite*  the  roots  of  the  closed-loop  optimal  system  will  still  systematically 
approach  those  of  the  model. 
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SECTION  4 


THE  SINGLE  CONTROLLER  LINEAR  OPTIMAL  SYSTEM 


4. 1  INTRODUCTION 

R,E.  Kalman  stated  that  the  major  contributions  of  linear  optimal  con¬ 
trol  will  be  to  the  conceptual  design  of  high  order  multi-controller  multi¬ 
output  control  systems*  It  has  been  shown  that  the  resulting  closed-loop  opti¬ 
mal  system  is  stable  and  well  behaved*  with  an  initial  condition  response  that 
always  tends  to  approach  the  response  of  a  Butterworth  filter  as  the  weighting 
of  the  error  portion  of  the  performance  index  is  made  large  relative  to  the 
control.  The  control  system  designer  need  only  select  the  Q  and  the  R  ma¬ 
trix,  perhaps  by  trial  and  error*  or  possibly  using  root  square  locus  tech¬ 
niques*  and*  using  a  large  digital  computer*  an  optimal  control  law  can  be 
computed. 

A  major  limitation  of  the  method  just  described  is  that  the  relationships 
that  exist  between  the  parameters  of  the  performance  index*  the  closed-loop 
dynamic  characteristics*  and  the  feedback  gains  are  only  qualitatively  known. 
The  multivariable  root  square  locus*  developed  elsewhere  in  this  report*  des¬ 
cribes  in  fair  detail  the  relationships  that  exist  between  the  performance  index 
parameters  and  the  closed-loop  poles  of  optimal  systems*  but  no  such  clear 
and  straightforward  relationships  are  known  to  exist  to  determine  the  closed 
form  connections  among  the  Q  and  R  matrices  of  the  performance  index  and 
the  feedback  gains  of  multivariable  systems. 

When  dealing  with  single  controller  systems*  however*  the  relationships 
that  exist  among  the  performance  index  parameters*  the  closed-loop  optimal 
dynamics*  and  the  feedback  gains  are  not  difficult  to  obtain.  The  single  con¬ 
troller  class  of  systems  is  not  Insignificant  or  unimportant  and  it  will  be  in¬ 
structive  to  demonstrate  the  essential  relationships  of  single  controller  opti¬ 
mal  systems. 

4.  2  FEEDBACK  GAINS  AS  A  FUNCTION  OF  Q  AND  R 

It  will  be  found  in  Section  3*  Equation  3-20*  that  the  optimal  charac¬ 
teristic  equation  and  adjoint  are  given  by  the  determinant 

-H'QH 

or  by  the  spectral  factored  product 

\ls-(F-Gki)  |  *0  (4-2) 


(4-1) 


Because  the  development  here  is  restricted  to  single  controller  sys¬ 
tems  only*  the  zeros  of  the  optimal  system  cannot  be  altered  by  feedback  gains 
only.  The  zeros  of  the  closed-loop  system  will  be  the  same  as  those  of  the 
open-loop  system*  and  only  the  denominator*  or  characteristic  equation*  will 
be  altered.  Equations  4-1  and  4-2  are  sufficient  therefore  to  completely  des¬ 
cribe  the  optimal  system  and  its  adjoint.  Equating  the  two  determinants  will 
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therefore  yield  two  polynomials;  of  which  the  coefficient  of  one  ie  a  function 
of  U  and  K »  while  the  other  ie  a  function  of  the  feedback  gain  K.  Equaling  the 
coefficients  will  then  yield  a  set  of  equations  relating  the  feedback  gains  with 
the  elements  of  the  Q  and  R  matrices.  In  addition,  because  the  relationships 
between  the  dynamic  characteristics  (such  as  closed-loop  natural  frequency 
and  damping  ratio)  and  the  feedback  gains  are  known,  these  dynamic  charac¬ 
teristics  can  be  also  related  to  the  elements  of  the  Q  and  R  matrices. 

Example: 

Consider  the  plant  that  can  be  completely  described  by  the  following 
transfer  function 

C  /.i  _  b 

IS {  }  1(7737'  «-3) 

whose  state  description  can  be  written: 


(4-4) 


Consider  a  performance  index  for  this  system  of  the  form 
oo 


M  *  /(«,*,*  *  <t,  */  *  ru.*)dt 


(4-5) 


The  characteristic  equation  for  the  optimum  and  adjoint  is  given  by 
Equation  4-2. 

,1s  ‘10  0 

I  r.-F  w'a'\  .  ...  .  j. 


■H'QM  -Is-F' 


0  s  **  0  tfr 

-Q  0  - «  0 

0  -<{t  - 1  -$+4 


The  closed-loop  optimal  system  matrix  is  of  the  form 

"0  *1  o' 

-  -  ft,  *,] 

0  b  “ 


0  *1 
_  ~bk,  -  d- 


(4-6) 


(4-7) 


(4-8) 
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After  substituting  in  Equation  4-2,  the  character*  «Hr  of  th?; 

optimal  system  becomes 


(4-9) 


-  -/ 

V  if 

-s  *bk, 

+bk,  *+*  +  bk% 

- 1  -s*d**bk2 

or 


s+-$*  [~2Mf  +a,z+  Zabkg  +6*6/]  *  b*k*  "  O 


(4-10) 


Equating  the  coefficients  of  powers  of  s  of  Equations  4-7  and  4-10,  there 
results  a  set  of  equations  from  which  k  can  be  obtained  as  a  function  of  the  un¬ 
knowns  and  fr  . 

-  2kt  *  2akt  *•  bkf  *  -~~ 

k*  .  JL 

r 


(a) 

(b) 


(4-11) 


The  polynomials,  Equation  4-7  or  4-10,  are  of  the  form 

*4m  *  *  &  <Jnu)  * 0>*J  *[•*+ 2 Z<t)n  9  +  CL>n  ][s *-  $♦*>«*/*  0 

so  that  the  solutions  for  kt  and  kt  can  be  expressed  in  terms  of  9//?*  and 
9s /r  or  the  closed-loop  natural  frequency  and  damping.  The  characteristic 
equation  of  the  closed-loop  optimal  system  is,  from  the  first  determinant  of 
Equation  4-9, 


s2*  *(&  +  6kx)  +  bk,  -  Sl*Z^u  cO^s  +  (4-12) 

Because  stability  is  guaranteed  for  the  closed-loop  optimal  system,  the 
coefficients  A*bkx  and  hi t,  must  be  positive.  The  proper  solutions  of  ltt  and 
kt  from  Equation  4-11  are 


If  it  is  desired,  Equations  4-12  and  4-13  can  be  easily  manipulated  to 
obtain  the  closed-loop  frequency  and  damping  as  a  function  of  9f  jr  and  4*  /r  . 

It  can  be  seen  that  direct  relationships  do  exist  between  the  elements 
of  the  performance  index,  the  closed-loop  characteristics,  and  the  feedback 
gains.  The  matter  of  obtaining  a  particular  optimal  configuration  is  simply 
a  matter  of  the  proper  selection  of  the  performance  index. 
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eg?  jjjjy.i*1- 


4.  3  PERFORMANCE  INDEX  FOR  RESTRICTED  FEEDBACK 

U»ing  the  same  dynamic  system  of  Equations  4-4  assume  that  it  is  de¬ 
sired  to  obtain  the  form  of  the  performance  index  that  yields  feedback  from 
the  variable  only.  That  is  to  say*  position  feedback  only  is  to  be  allowed. 
What  quadratic  performance  index  will  yield  position  feedback  only?  With  this 
requirement  in  mind.  Equation  4-9  can  be  reformulated,  setting  =  0. 


3  -1 

*  -bkf 

bit t  s»a 

1  i-a 

or 


(si*as  *  bbt)(s*~A>s  + 

6^-  (a*-  Zbkf)  *  ■ O 


-  O 


(4-14) 


(4-15) 


Equating  coefficients  of  Equations  4-15  and  4-7. 

*.  t  - 

4* 


Jl 

r 


(a) 

(b) 


(4-16) 


Eliminating  k,  from  Equations  4-  16a  and  Equation  4-l6b.  the  requirement 
that  position  feedback  only  be  allowed  is 

b* 


or 


-  47  V 


eii 


r 


(4-17) 


and  the  resulting  performance  index  is 

ao 

2 


2V 


dt 


(4-18) 


Consider  a  numerical  example  of  the  limited  feedback  problem.  Let 
the  dynamic  system  be  represented  by  the  set  of  first-order  equations 

p-  ^  r  t  r  *i  r  *1 

o  1 


** 


X. 


0 

2 


and  let  the  performance  index  be 

ZV  m  /  f9'  ** 


(4-19) 


(4-^0) 
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The  equation  of  tlic  optimal  system  and  its  adjoint  is 

given  by  substituting  in  Equation  4-7 

S*-Sz(4-  4JJP  -  0  (4-21) 

The  locus  of  the  roots  of  the  optimal  system  and  adjoint  is  given  in 
Figure  7,  It  can  be  seen  that  the  negative  sign  in  Equation  4-17,  as  selected 
in  this  problem,  yields  position  feedback  in  the  conventional  degenerate  sense. 
The  Butterworth  distribution  of  roots  is  not  obtained,  however.  Two  obser¬ 
vations  may  be  made  from  this  example: 

1,  A  Q  matrix  that  is  not  positive  definite  or  non-negative  definite 
may  still  yield  a  stable  closed-loop  system. 

2.  It  appears  that  the  system  may  have  closed-loop  poles  other 
than  those  approximating  a  Butterworth  distribution  if 
elements  of  the  Q  matrix  are  allowed  to  be  negative. 


OPTIMAL  SYSTEM  ADJOINT  SYSTEM 

Figure  7,  Locus  of  the  Roots  of  the  Optimal  System  - 
Position  Feedback  Only 


61 


Consider  one  other  variation  of  the  single  controller  problem  oi  this 
section.  Up  to  this  point*  the  resulting  closed-loop  optimal  system  has  been 
a  regulator.  No  inputs  ether  than  initial  conditions  have  been  considered. 
Other  inputs  can  certainly  be  considered*  however*  merely  by  incorporating 
the  state  variable  description  of  this  input  into  the  plant  as  an  uncontrollable 
part  of  the  plant.  Consider*  for  instance*  a  step  input.  This  step  can  be  des¬ 
cribed  as  a  first-order  differential  equation  ae: 

-0 

Attaching  this  vector  to  the  plant  of  Equation  4-4*  there  results  the  system 


(4-22) 


Because  it  can  be  desired  to  minimize  the  error  between  the  step  input 
and  the  output*  a  performance  index  of  the  following  form  may  be  selected 

ZV  »  +  ru*]dt 

or  0 

ZV  -  +  (4-23) 

o 


The  resulting  optimal  system  will  be  of  the  form  indicated  in  the 
sketch  below. 


IMPULSE 


If  the  determinants  of  Equations  4-1  and  4-2  were  expanded  and  the 
coefficients  were  equated,  it  would  be  found  that  ^  could  not  be  obtained  in 
this  manner.  The  kt  can  be  found  from  the  Riccati  equation  or  by  using 
S.S.  L.  Chang's  approach.  If  computed,  it  would  be  found  that  kt  -  kf  .  It 
would  also  be  found  that  the  closed-loop  part  of  the  system  ie  still  an  optimal 
regulator. 
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It  has  been  found  in  general  that  the  closed-loop  regulator  part  of  the 
system  is  not  a  func  tion  of  the  excitation  to  the  system.  The  input  gains  to  the 
system,  such  as  the  k t'  of  the  above  sketch,  will  bo  a  func  tion  of  the  dynamic 
characteristics  of  the  system  excitation.  This  can  be  easily  understood  be¬ 
cause  each  of  the  state  variables  required  to  describe  the  input  excitation  con¬ 
tribute  to  the  closed-loop  part  of  the  system. 

The  input  problem  and  other  problems  discussed  in  this  section  demon¬ 
strate  that  there  are  definite,  fixed  relationships  that  exist  among  the  param¬ 
eters  of  a  quadratic  performance  index  and  the  characteristics  of  the  optimal 
closed-loop  system.  The  simple  examples  have  shown  that  much  of  the  con¬ 
ventional  control  terminology,  such  as  natural  frequency  and  damping  ratio, 
can  be  expressed  in  terms  of  the  parameters  of  the  quadratic  performance  index. 

It  was  not  the  intent  of  this  section,  however,  to  show  that  everything 
done  by  optimal  control  could  be  done  by  conventional  techniques.  Optimal 
control  yields  a  method  whereby  systems  of  large  dimension  and  many  inputs 
can  be  computer  designed,  with  the  knowledge  that  a  positive  definite  matrix 
R  and  a  non-negative  definite  matrix  Q  yield  a  system  known  to  have  desirable 
characteristics.  It  these  two  conditions  are  met,  the  system  is  guaranteed  to 
be  stable  and  the  response  of  the  closed-loop  optimal  system  rapidly  approaches 
the  response  of  a  Butterworth  filter,  smooth  and  well  behaved. 

Possibly  the  most  important  characteristic  of  linear  optimal  techniques 
is  the  freedom  of  the  designer  to  qualitatively  determine  the  amplitudes  of  the 
motions  of  the  controller  inputs  to  the  system.  If  the  control  motions  of  a 
linear  optimal  design  are  too  large,  it  is  necessary  only  to  increase  the  weight¬ 
ing  on  the  controller  in  the  performance  index  and  the  next  design  will  have 
lower  control  motions  but  at  the  expense  of  greater  error.  In  either  case,  the 
integral  of  the  square  of  the  control  motions  is  minimized.  This  means  that 
large  excursions  of  the  control  are  discouraged  for  any  weighting  of  the  con¬ 
trol  in  the  performance  index.  In  fact,  S.S.  L.  Chang  (Reference  3)  demon¬ 
strates  that  for  the  same  speed  of  response,  the  linear  optimal  system  yields 
lower  amplitude  control  motions  over  a  conventionally  designed  system. 


SECTION  5 

LONGITUDINAL  SHORT  PERIOD  OPTIMAL  FLIGHT  CONTROL 


5. 1  INTRODUCTION 

It  is  possible  to  use  variational  techniques  to  conceptually  design  a 
flight  control  system  to  satisfy  flying  qualities  requirements  for  a  longitudinal 
short  period  aircraft  representation.  By  the  proper  choice  of  the  flight  par¬ 
ameters  that  are  included  in  the  performance  index,  and  by  proper  weighting 
of  these  state  and  control  variables,  it  appears  that  any  combination  of  closed- 
loop  short  period  natural  frequency  and  damping  may  be  obtained.  However, 
conventional  design  techniques  also  exist  that  can  do  the  same  thing,  and  it  is 
important  to  ask  why  one  would  choose  the  variational  approach  when  conven¬ 
tional  techniques  now  exist. 

The  answers  lie  in  the  fact  that  the  conventional  techniques  do  not 
necessarily  produce  a  unique  solution;  there  is  more  than  one  way  to  achieve 
the  same  aircraft  frequency  and  damping.  Optimal  control  can  be  used  as  a 
tool  to  help  select  a  particular  solution.  In  doing  so,  it  has  been  found  from 
experience  that  the  control  motions  required  to  achieve  a  particular  response 
are  generally  smoother  and  more  well  behaved.  In  other  words,  optimal  con¬ 
trol  considers  the  behavior  of  the  control  deflections  as  well  as  the  dynamic 
characteristics  of  the  state  variables.  Because  of  this,  it  is  very  possible 
that  the  optimal  feedback  will  be  quite  different  from  the  feedback  obtained 
by  conventional  techniques,  even  of  a  reversed  sense.  Therefore,  although  it 
is  true  that  optimal  control  will  produce  nothing  new  for  so  simple  an  example, 
the  principles  in  the  use  of  optimal  techniques  will  be  well  illustrated,  and  par¬ 
allels  in  design  techniques  between  conventional  and  optimal  methods  will  be¬ 
come  evident. 

5.2  A  DESIGN  PHILOSOPHY 

The  general  principles  that  guide  a  control  system  designer  using  con¬ 
ventional  design  techniques,  such  as  root  locus  plots,  have  par^Uvls  in  root 
square  locus  design.  For  instance,  to  increase  the  short  perio  !  natural  fre¬ 
quency,  a  control  system  engineer  may  specify  angle  of  attack  feedback  to  the 
elevator  such  that  a  positive  incremental  angle  of  attack  change  produces  a 
positive  incremental  elevator  deflection.  Conversely,  to  decrease  the  short 
period  frequency,  a  negative  elevator  increment  is  produced  by  a  positive 
angle  of  attack  change.  It  has  been  found  that  design  by  linear  optimal  control 
techniques  produces  similar  principles  of  design.  In  order  to  increase  the 
speed  of  response  of  a  linear  optimal  system,  the  weighting  on  the  state  var¬ 
iables  is  made  larger.  To  decrease  the  natural  frequency,  a  weighting  factor 
can  be  made  negative. 

To  qualitatively  understand  how  the  response  of  a  multivariable  linear 
optimal  system  varies  as  a  function  of  the  performance  index,  it  should  be 
recalled  that  the  response  of  the  variable  that  appears  in  the  performance  in¬ 
dex  will  approach  the  response  of  a  Butterworth  filter  as  the  weighting  of  the 
output  variable  is  made  large  with  respect  to  the  control  variable.  For  in¬ 
stance,  consider  the  performance  index 
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2V  &  ffo&e*  +  r&Sel)dt 

0 

with  a  two-degree-of-freedom  set  of  longitudinal  equations  of  motion  of  a  nor* 
mal  aircraft.  The  transient  responses  of  the  optimal  system  will  look  as 
sketched  below: 


On  the  other  hand,  an  optimal  design  of  the  same  aircraft,  but  with  the  per¬ 
formance  index  oo 

2V  -/ (qAcc*+  r&Sel)dt 

o 

will  have  optimal  system  transient  responses  resembling  those  sketched  below. 


Applying  what  is  presently  known  about  aircraft  flying  qualities,  one  can 
establish  a  clear  advantage  of  one  index  over  the  other.  In  this  hypothetical 
case,  the  second  may  be  more  desirable. 

The  normal  acceleration  short  period  response  of  a  modern  military 
fighter  aircraft  is  similar  to  the  angle  of  attack  response  with  the  exception 
that  an  accelerometer  located  at  the  center  of  gravity  of  the  aircraft  shows  a 
delay,  or  a  nonminimum  phase  characteristic.  This  characteristic  may 
cause  instability  if  is  used  in  a  feedback  design  philosophy,  but  not  if 

linear  optimal  techniques  are  used. 

Since  it  can  be  hypothesised  that  an  aircraft  having  a  response  approach¬ 
ing  a  Butterworth  filter  response  in  either  dtf  or  may  be  acceptable  from 
a  flying  qualities  point  of  view,  it  will  be  instructive  to  show  how  the  two  var¬ 
iables  can  be  combined  in  a  performance  index  to  yield  a  wide  range  of  closed- 
loop  natural  frequencies  and  damping  ratios. 
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Consider  the  aircraft  short  period  representation  described  in  part 
by  the  following  transfer  functions 

doc  _  C^at  9*t) 


AS* 


weir 

Uft,/  Of, 


s  *1 
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\  —  nf 


s  + 1 


(5-n 


where  A  et  *  incremental  angle  of  attack 

d  tfj  =  incremental  normal  acceleration 
d  £  =  incremental  elevator  deflection 

Let  it  be  assumed  that  the  following  performance  index  will  be  used  to  define 
the  optimal  system 

at 

2V‘  7s*  r&S^c/t  (5-2) 


where 


9  =  weighting  factor  of  the  state  variable 
Y  -  weighting  factor  of  the  control  variable 
k  -  a  positive  scalar 


Accordingly*  the  transfer  function  to  be  considered  for  the  root  square 
locus  is 


_ A_  . 

&8t  W  *  ASe(') 


ki^  ( 7*,  5  +•  l ) 

TJ-JT— ~ 

rrl  +tt-  s*t 


(5-3) 


The  scalar  k  serves  to  alter  the  zeros  of  the  over-all  transfer  function 
A/d^fs).  It  is  to  these  altered  zeros  that  the  closed-loop  roots  will  migrate  as 
q/r  is  increased.  Consider  the  locus  of  the  zeros  of  the  transfer  function  of 
Equation  5-3  with  ±k  as  the  parameter.  See  the  sketch  below: 


Figure  8.  Locus  of  Zeros  of  (t)±  k  (9) 


66 


ML 


.  3j 


The  sketch  on  the  previous  page  shows  that  the  zeros  of  the  function 
tk  can  be  made  to  change  almost  at  will  along  the  real  axis  ac¬ 

cording  to  the  sense  and  magnitude  of  k. 

The  importance  of  this  to  root  square  locus  design  nrnr*Hm»»;  i-  that 
the  poles  of  tue  real  and  me  “adjoint"  system  migrate  to  the  zeros  of  the  real 
and  the  "adjoint"  system.  Since  these  zeros  are  adjustable  nearly  an*'  /here 
along  the  real  axis,  the  poles  of  closed-loop  optimal  system  can  be  made  to 
migrate  to  nearly  any  point  on  the  negative  real  axis. 


Consider  the  following  sketch.  Figure  9,  which  depicts  the  complete 
root  square  locus  for  four  different  values  of  k  in  a  performance  index. 


- solid  line  -  root  square  locus  for  +-r tS^%]dt 

—  —  dashed  line  -  root  square  locus  for  /[%&*)* *  rLS^Jdi 

—  dot-dash  line  -  root  square  locus  for  f  [)(&••  ktA»))t*r  AS**]  <M 

. dotted  line  -  root  square  locus  for 

A*  dtt 

O  solid  circles  -  zeros  of  (s) 

□  solid  squares  -  zeros  of  (i) and  (-s) 

!:i  dotted  squares  -  zeros  of^fsj-  ^ 

O  dotted  circles  -  zeros  of 

Figure  9*  Sketch  of  the  Poles  of  the  Optimal  System 
for  Several  Values  of  k 
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It  can  be  seen  from  the  sketches  that  a  wide  range  of  closed-loop  natur¬ 
al  frequencies  and  damping  ratios  can  be  obtained  simply  by  choosing  the  sense 
and  the  magnitude  of  the  scalar  k  that  appears  in  the  performance  index  associ¬ 
ated  with  each  of  the  root  square  loci*  By  choosing  +k,  the  natural  frequency 
is  generally  increased:  hy  choosing  -k,  the  natural  frequency  1»  generally 
decreased. 

Examples  of  this  method  of  root  square  locus  design  have  been  done  on 
the  ESIAC  computer.  Natural  frequencies  and  damping  ratios  well  within  the 
flight  dynamics  acceptable  iso-opinion  specification  can  be  obtained. 

5. 3  NUMERICAL  EXAMPLE  OF  ANALYSIS  OVER  A  FLIGHT  RANGE 

An  example  using  the  equations  of  longitudinal  motion  of  a  modern- 
high-performance  aircraft  will  serve  to  illustrate  the  manner  in  which  the  non¬ 
minimum  phase  characteristics  can  be  used  to  good  advantage,  as  outlined  above. 

The  equations  of  motion  are  assumed  to  be  given  by 

49  ■  *  Mf  &$€  Pitching  Acceleration  Equation 

ae-  4£  «  L€Ak*  Lg&fe  Flight  Path  Velocity  Equation 

*  LSe  -  ASC  Actuator  Dynamics 

Aerodynamic  derivatives  are  hypothesized  that  might  represent  a 
wide  range  of  flight  conditions  as  indicated  in  Table  1  below.  Transfer  func¬ 
tions!  for  use  in  the  root  square  locus»  are  next  developed  and  tabulated  in 
Table  2. 


TABLE  1 

AERODYNAMIC  DERIVATIVES 


Flight  Condition 

Af# 

A  -  Power 
Approach 

-.741 

-.257 

-.267 

-2.09 

.535 

.110 

.05 

B  -  M  =  ,  5 

Sea  Level 

-4.75 

-.542 

-.0638 

-13.1 

1.09 

.255 

.05 

C  -  M  =  .9 

Sea  Level 

-13.0 

-1.60 

0 

-39.4 

.991 

.415 

.05 

D  -  M  «  1.2 

Sea  Level 

-43.7 

-2.16 

0 

-59.3 

1.363 

.438 

.05 

E  -  M  *  0. 6 

40.  000  ft 

1 

H- 

• 

OD 

-4 

-.194 

-.0210 

-4.86 

.375 

.0795 

.05 

F  -  M  «  2 

60,  000  ft 

-9.99 

-.249 

0 

-9.45 

.140 

.0417 

.05 
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The  transfer  function*  are: 


6$ 


(*) 


*i(T4*  +  0 


ASt 
where: 


C€  ~MhL$€ 

f,4< 

A%  la  - 


d*_ 


*r« 

A’ll  .  *S(o*  »’‘«*sw) 


W^W^T 

"W 


„  #■  Mf  4/g 

-  *  “^r^pr 


s  •  l  *> 


“i  *  /:A*e-M,V 


d.*  -  ■  Af^ 

2  -M^  L*  1 


Fit. 

Cond. 

A 

B 

C 

D 

E 

F 


* 

** 

.935 

.502 

-1.175 

2.30 

.370 

-2.48 

3.80 

.340 

-2. 33 

6.80 

.260 

-1.33 

1.40 

.  21 Q 

-.866 

3.70 

.  069 

-.136 

TABLE  2 

TRANSFER  FUNCTION  PARAMETERS 


7«  *«  r» 

-2.40  2.02  .0520  -6.90 

-2.50  1.000  .0190  -43.0 
-2.75  1.16  .01035  -72.8 

-1.30  0.730  .00725  -55.5 
-2.50  2.90  .0158  -15.7 

-.950  6.90  .0044  -9.08 


-.106 

-.0190 

-.0120 

-.0071 

-.0476 

-.0304 


-.012 
-.0197 
-.0150 
-.0930 
-.  00755 


«ivn.nW^“m  **  th*  X-fr-dom  aircraft  r.pr...«tation  i. 
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Consider  the  criterion  of  design  to  be  given  by  the  integral: 


2V  m  f  [(A«t  +  lcA»y)*q+rASi*]<ft 


(5-4) 


The  root  square  locus  expression  becomes: 

a  A  A 

*+  T  7T  *  0 


r  ASt 


where 


A  ,  . 

7T(S) 


it'”* 


In  terms  of  the  parameters  of  Table  2,  %  <•>  becomes: 
A  kt*  (TtS*  fj+itkfn^lb+s**  **s+l) 

s, {9)*  r  s  ; 

c4cr 


~  *  .1  17  s  \t  it  : 

Xcr  J  [W  *  S<,# 


r5-5) 


(5-6) 


It  was  decided  to  select  a  constant  value  for  k  and  obtain  the  root 
square  loci  for  the  six  flight  conditions  listed  in  Table  1.  The  value  selected 
for  k  was  +0,  3.  It  was  felt  that  this  selection  would  yield  a  set  of  zeros  of 
the  root  square  locus  plots  that  would  in  general  influence  the  closed- loop  pole 
positions  in  a  desirable  manner.  The  selection  of  Ax*kLj>^  as  the  state  variable 
term  of  the  performance  index  with  k  a  constant  also  indicates  a  trade-off  is 
made  among  the  flight  conditions  as  to  the  major  contributor  among  the  vari¬ 
ables  in  the  performance  index.  At  the  power  approach  flight  condition. 

>kten  and  the  major  contributor  to  the  performance  index  is  the  var¬ 
iable  Ax  .  Tn  a  high  dynamic  pressure  flight  condition,  an  elevator  deflection 
will  produce  normal  acceleration  changes  that  are  large  relative  to  the  change 
in  angle  of  attack,  and  the  major  contribution  to  the  performance  index  will 
be  made  by  the  normal  acceleration  variable  Ax^  .  So  the  index  of  perform¬ 
ance  will  reflect  a  desire  to  minimize  excursions  of  angle  of  attack  at  the 
power  approach  and  normal  accelerations  at  high  dynamic  pressure  flight 
conditions. 


70 


-<y  /O’ 


.  .  ..  substituting  the  numerical  values  for  the  aerodynamic  derivatives 

£?.£££?£ SSST  °‘  Equa*lon  5-6>  ““  roo‘ 

Power  Aoproach:  -d*  !n~*  .  —  _  _ _ (  4-47  Jf*  fjl  **) _ 

M  B  0.5,  Sea  Level:  -4.2  xfO‘*  ■  — — - L  T-4  (*  t-d  _ 

r  wtSr^777] 

M  e  0.9,  Sea  Level:  -M»  -  —  — - ^_7a»  * ')  (*  * ') 

M  =  1.2,  Sea  Level:  ,<,-5  ,  J _ (*  7S? f* * *) 

M=  0.6,  40,000  ft:  _L_ 


M  =  0.9,  Sea  Level:  "  f <7  x  IQ  «  —— 


M  =  0.6,  40,  000  ft: 


-t. 9  *  tO'Z  -  ~ 


M  =  2. 0,  60,  000  ft: 


7.4  xlO’1  -  -L 


I _ (*  &**)[*  T9") 

r 


.  ..  The  actual  root  square  locus  plots  for  the  optimal  systems  with  a/r 

rtSEST**."'  #h°Wn  ln  Flgures  10  through  15.  Fo/clarity,  the  locus 
of  the  adjoint  system  was  not  included  in  the  plots. 

14  canb*  that  th®  Pol®#  of  the  closed-loop  optimal  system  oriei- 
j  ^  sssociated  with  the  short  period  mode  of  motion  become  more  hiahlv 
damped  and  have  a  higher  natural  frequency.  In  general  fWinTaillitfe.  r. 

cuiar  aircraft.  There  is  one  noticeable  exception,  however.  The  closad. 
SKffi11  flight  condition  of  Mach  *  ,.2.  S.a  llv.l.  would  p'ro- 
W  f  any  Valu®  ot^r  •  This  comes  about  because  the  oris- 

*lrcr»f‘  »PP«»»*  to  have  a  .offlci.ntly  rapid  r.apoa..  without 
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The  actual  implementation  of  the  type  of  system  conceptually  indicated 
by  the  root  square  locus  plots  would  require  a  programmed  feedback  gain 
schedule  as  a  function  of  flight  condition.  It  would  be  necessary  to  tabulate  the 
gn&r*»  to  ucwiiVuao  the  complexity  and  soundness  ox  such  a  program^  and  to  ob- 
tain  simplifying  approximations  to  the  exact  optimal  control  law.  It  is  never¬ 
theless  demonstrated  that  if  a  gain  program  were  feasiblej  an  optimal  approach 
to  flight  control  system  design  is  possible.  and  the  object  of  the  preceding  ex¬ 
ercise  has  been  achieved. 

The  root  square  locus  analysis  performed  in  this  section  is  really  one 
of  the  first  steps  to  be  performed  in  a  complete  analysis  of  a  flight  control  sys¬ 
tem.  Additional  characteristics  such  as  feedback  gains(  transient  responses 
and  sensor  dynamics  and  location  must  be  investigated.  Experimentation  must 
be  undertaken  to  determine  pilot  reaction  to  the  new  closed-loop  characteristics 
of  the  stability  augmented  vehicle.  In  short,  many  factors  must  be  investigated 
in  addition  to  closed-loop  root  locations,  but  the  closed-loop  roots  are  impor¬ 
tant  and  they  can  be  easily  controlled  using  linear  optimal  control  techniques. 
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A  \  - ‘  S  ‘v5;:;'i  “* 

Flgur.  10.  R°*Sou«.  Locu.  for  th,  P„£orm.ne.  Criterion 
*&t  -  Power  Approach 
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SECTION  6 

MINIMIZATION  IN  THE  FREQUENCY  DOMAIN  - 
THE  SINGLE  VARIABLE  PROBLEM 

6. 1  INTRODUCTION 

For  the  most  part,  the  previous  sections  have  emphasized  a  time  do¬ 
main  approach  to  linear  optimal  control  which  relied  on  the  conventional  tech¬ 
niques  of  the  calculus  of  variations  for  its  theoretical  development.  However, 
there  is  merit  in  covering  essentially  the  same  material  using  a  frequency 
domain  approach,  if  for  no  other  reason  than  that  there  are  a  large  number  of 
control  engineers  who  would  prefer  it  this  way. 

In  this  section,  and  the  two  which  follow  it,  a  frequency  domain  ap¬ 
proach  to  linear  optimal  control  is  developed  which  requires  the  use  of  anal¬ 
ysis  methods  which,  for  the  most  part,  are  familiar  to  the  majority  of  engi¬ 
neers  (e.g.,  root  locus,  solution  of  linear  sets  of  equations  using  Cramer's 
Rule,  etc. ). 

In  this  section,  a  brief  survey  of  the  technique  for  minimizing  a  quad¬ 
ratic  performance  index  with  only  one  available  control  variable,  in  the  man¬ 
ner  developed  by  S,  S.  L.  Chang,  is  presented.  For  this  case,  it  is  shown  that 
the  frequency  domain  equation  of  interest  is  a  scalar  equation  of  the  Wiener- 
Hopf  type  that  can  be  solved  using  what  is  now  considered  to  be  a  standard 
technique  (spectral  factorization).  The  theory  is  developed  for  both  the  optimal 
transfer  function  and  the  optimal  control  with  examples  given  to  demonstrate 
the  application  of  the  latter.  The  section  concludes  by  giving  one  possible 
solution  to  the  "problem  of  the  type  zero  plant"  and  for  this  problem  demon¬ 
strates  equivalence  between  the  time  domain  approach  and  frequency  domain 
approach. 

The  extension  of  the  methods  of  this  section  to  the  multi-control  case 
is  given  in  Section  7. 

6.  2  THEORY  FOR  THE  OPTIMUM  TRANSFER  FUNCTION 

In  Figure  16,  W(s)  represents  the  fixed  elements  of  the  system.  The 
compensating  network,  W&  »  is  to  be  designed  in  such  a  fashion  that  the  ex¬ 
pression  go  at 

jelD*  dt*kl  ju(t)*M  (6.1) 

is  minimized.  9  * 


Figure  16.  Single  Control  Optimal  System 


In  Equation  6-1  Jf  •  £  e2 dt  is  the  integral  square  error  and 

J \  m  f  U*  dt  represents  the  integral  square  value  of  the  control  effort* 

* 

^hs'rg's  theory  is  dsv«lop«u  l»y  obtaining  an  equivalent  frequency  domain 
expression  for  Equation  6-1  in  terms  of  the  system  transfer  function  through 
the  use  of  Parseval's  Theorem,  The  word  equivalent  is  emphasised*  for  one 
must  continually  bear  in  mind  the  conditions  under  which  the  time  domain  ex¬ 
pression  is  equal  to  the  frequency  domain  expression. 


Before  proceeding*  a  basic  characteristic  of  Parseval's  Theorem 
should  be  pointed  out.  The  theorem  states^ 


fa(*)2dt  -  ~j-  M%)  A (-•)  ds 


where 


09 

o(\t *  f  z(t)e~9tdt  mA(s) 


(6-2) 


(6-3) 


Suppose  A(s)  has  poles  and  zeros  in  the  right-half  plane.  Under  these  condi¬ 
tions*  the  left-hand  side  of  Equation  6-2  does  not  exist.  Consider  now  the 
right-hand  side  of  Equation  6-2.  The  evaluation  of  an  integral  expression  such 
as  this  is  easily  carried  out  through  the  use  of  standard  tables  (Reference  11). 

It  is  always  possible  to  write 

A(s)  »A1(3)At( s)  (6-4) 

where  A ,  ( s)  contains  only  left-half  plane  poles  and  seros  and  At  (s)  is  the 
all-pass  network  necessary  to  maintain  the  equality  of  Equation  6-4.  An  ex¬ 
ample  will  make  this  clearer.  Suppose 

- TfStf 

Equation  6-5  can  then  be  written; 


A(») 


(6-5) 


A<$)  - 

l 

(6-6) 

(rt»* i)(tB9+o  \  r,i+f  J 

l  -n*W  l 

Consider  now 

A  (>)*(-•) 

47 (ti 

•  A,(»)  A,  H)At(s)At  (•$) 
mAt(t)At(-*) 

A i(t) 

(6-7) 

This  is  true  because  the 
unity*  that  is* 

product  of  an  all-pass  network  with  its  conjugate  is 

At(*)At(-$)  »/ 

(6-8) 

This*  of  course*  means  that  the  expression 


/ 


JimA(*)A(-t)ds 


is  evaluated  as  though  A(s)  had  only  left-half  plane  poles  and  seros.  It  is  all 
too  easy  to  forget*  when  one  works  strictly  with  the  frequency  domain  expres¬ 
sions*  that  the  equivalence  between  the  two  sides  of  the  equations  is  voided 
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I  'v- 


when  A(s)  and  A(-s)  no  longer  possess  a  common  convergence  factor.  That  is, 
there  is  no  longer  an  analytic  continuation  from  the  left-half  to  the  right-half 
plane*  and  vice  versa. 


We  return  now  to  Equation  6-1  and  apply  Parseval's  theorem: 
ss  J—  jss 

}[ ei(t)*Liui]dt  «  [&(*)&(•%)  4$  *  —  f u($)u(-s)ds 

i  J  arj  Jim  2rrj 

Equation  6-9  can  be  rewritten  in  terms  of  the  transfer  function 

it 


A 

n 


r(s)' 


and  becomes*  after  a  few  manipulations* 

J®* 


j,  *  i.  =  7ST  /  WB(-s)dt 

-JW 


JL  f 

2/ry  J 


-i" 


Pfs)P(,-s)'gfo)g(,-s) 
W(9)  W(-s) 


e/s 


(6-9) 


(6-10) 


(6-11) 


It  is  now  required  that  one  find  the  F(s)  that  minimizes  Equation  6-11* 

that  is* 

JJ  +  lc*  •  min.  (6-12) 

An  arbitrary  F(s)  is  written  as 

)~f0(9)+  %rf(9) 

where  %  is  a  constant*  F0  i*  the  optimum  transfer  function*  and  Ft  is  any 
arbitrary*  but  physically  realizable*  transfer  function.  In  other  words*  one 
takes  a  variation  on  F(s).  The  result  is 


(6-13) 


where 


tNot  to  be  confused  with  the  time  domain  F  matrix  used  elaevhere  in  this 
report. 
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1 

k*F»  ’ 

L  I1' 

v  V  ♦ 

WW 

* 

jo# 

/  [* 

Ll 

2/Tj 

J,  L 

00  u 

*  ~ww 

izie  f,  c/s 


EEc/s 


and  F 


3a  »■  the  "optimum",  is  >  0  and  Jj,  =  3*c  ,  since  3^  (*)  =  *k(-s) .  From 

th4  5  it  follows  that  a  necessary  and  sufficient  condition  for  to  give  the  lowest 
value  of  +  is,  for  arbitrary  Fj  ,  *  0  (see,  for  example,  Reference 


Thus  we  are  led  to  consider  the  equation 


/[• 

-j«L 


WW 


KVFtc(3  -0 


where  all  the  poles  of  ^  are  Inside  the  right-half  plane, 
identically  aero  if  all  the  poles  of 


<6-14) 

Equation  6-14  is 


(6-15) 


are  also  inside  the  right-half  plane,  and  the  path  of  Integration  is  completed 
to  the  left. 


The  behavior  of  the  integrand  on  the  semicircular  contour  must  be  ex¬ 
amined  to  assure  that  it  vanishes.  Thus  one  must  be  careful  that  Equation  6-15 
behaves  like  l/sa  as  s  -*»  *>  ,  assuring  the  convergence  of  the  integral  on  the 
semicircular  contour.  This  condition  is  usually  overlooked  and  can  be  easily 
violated  (for  example,  when  R(s)  *  1,  it  can  occur  that  (/£-?}  t  It*  F^/  WfH  is 
not  a  proper  rational  fraction  in  s). 


At  any  rate,  it  follows  that  a  necessary  and  sufficient  condition  for  a 
minimum  is  that 


I 


w9 


mf(*) 


have  right-half  plane  poles, 

Equation  6-16  is  then  rewritten  as 


(6-16) 


(6-17) 
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■K  ■' 


vx\,y 

-V.*- 


’  v>.- 


Let 


i*Sf  *  yw  Y<-> 


(6-18) 


and  note  that  Equation  6-18  is  not  changed  by  replacing  s  by  -s. 
Now,  Chang  defines 

n.) 


(  WW 


(6-19) 


to  be  a  function  with  all  left-half  plane  poles  and  zeros.  The  need  for  the  poles 
to  be  in  the  left-half  plane  cannot  be  justified.  However,  the  need  for  left-half 
plane  zeros  will  become  apparent  in  Equation  6-21.  The  process  for  finding 
Y(s)  is  called  spectral  factorization,  Chang  then  defines  a  function 

m  -  (eisiw-s)}* 

in  a  similar  manner.  Using  these  expressions*  Equation  6-17  becomes 


or 


Y7Z?F0-ZZ  *^(s) 


Yzr, 


7  ?i 


(6-20 


*/V  is  now  expanded  in  partial  fractions  to  give 


where  (a*/  V  ]  f  contains  the  terms  with  left-half  plane  poles  and  [t/7  ]. 
contains  the  terms  with  right-half  plane  poles.  Equation  6-20  becomes 


YZK 


(6-21) 


Since  all  the  poles  of  the  expression  on  the  left-hand  side  of  Equation  6-21  are 
left-half  plane  and  all  the  poles  on  the  right  side  are  right-half  plane,  the  op¬ 
timum  solution  is  (see  Reference  3): 


s 


r. 


i 

Yi 


(6-22) 


From  Equation  6-11,  we  see  that  J*  becomes  unbounded  when  W(s) 
has  right-half  plane  zeros  and  F(s)  does  not  have  the  same  zeros  as  W(s), 
Similarly,  if  R(s)  is  */*"  »  then  7)  becomes  unbounded  if  [F(s)  -  ljdoes  not 
have  a  free  s*  term.  Also,  becomes  unbounded  when  t/$n  and  W(s) 
does  not  have  a  free  f/s*  . 


One  of  the  difficult  points  in  the  theory  can  be  remedied  immediately. 
It  is  the  requirement  in  Equation  6-19  that  Y(s)  be  a  function  with  left-half 
plane  poles  which  causes  to  be  nonexistent  when  W(s)  is  non-minimum 
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phase.  It  is  apparent  that  this  difficulty  can  be  remedied  by  letting  frm  have 
the  open-loop  seros.  That  this  is  the  correct  thing  to  do  can  be  proven  by 
going  back  and  solving  for  the  optimal  control  u #  rather  than  the  optimal 
tr»n«f*r  function  F0  .  Thi»  will  be  done  in  the  next  section*  since  the  ex¬ 
pressions  for  the  optimal  controls  will  prove  to  be  the  real  quantities  of  inter¬ 
est  in  the  multidimensional  case. 

6.3  THE  OPTIMUM  CONTROL 

In  this  section*  S.S.  L.  Chang's  method  for  solving  the  least-square 
optimisation  problem  is  reformulated  by  solving  for  the  control  which  mini¬ 
mises  the  performance  index  (rather  than  the  transfer  function  which  mini¬ 
mises  the  index).  This  leads  one  directly  to  an  expression  for  the  system 
transfer  function  which  correctly  indicates  that  the  closed-loop  seros  are  the 
open-loop  seros. 


Figure  17.  Single  Control  -  Single  Output  Optimal  System 

In  Figure  17*  W  represents  the  fixed  elements  of  the  system.  The  per¬ 
formance  index 


V  *  f  (e*  t-k* u>M)d1 

o 

is  to  be  minimised  by  solving  for  the  optimal  control*  Ug  , 


6-23) 


since 


Equation  6-23  can  be  rewritten  in  the  equivalent  frequency  domain  form 

v "  wf.  ]*•  <6-24> 


V  ■  Wk  (6-25) 

One  now  takes  a  variation  on  Equation  6-24  by  letting 

(l  •U0  +  bu, 

where  is  physically  realisable*  but  otherwise  arbitrary.  The  result  is 

2V  *  Jg,  ♦  ^  JJf  (6-26) 

where  3*  is  the  optimum*  3^  is  >  0  and  Jfc  *  Te,  since  J*,  (a)  *  Tc  (~ s)  . 


Thu*  the  necessary  and  sufficient  condition  for  Ut  to  give  the  lowest  value  of 
V  is,  for  arbitrary  U,  ,  T&  3  0.  We  must  therefore  consider  the  equation 

^  -  77 -f  [k9u$-ft(K-Wue)]Hfcts  (6-27) 

J  -jm 

From  Equation  6-27,  it  is  apparent  that 


must  have  right-half  plane  poles. 
Let  k 1*  WW  *  V  V  m 


NlQ  +  k*DD 
DS 


(6-28) 


and  let 


where  W  *  ^/j) 


Y 


(a/^7  +1*dT5  }+ 
~  V 


(6-29) 


Here  we  let  Y  have  as  poles  all  of  the  open-loop  poles,  D,  in  order  to  insure 
that  Equation  6-24  will  exist  when  there  are  open-loop  poles  in  the  right-half 
plane.  Equation  6-28  becomes 


-  W  2  3  /f(s) 


and  the  optimum  value  of 

u  is 

1 

H  m  _ 

'  1 

D 

r  jvc  1 

•  y 

7  J 

+ 

{wff***P5/*  L  J 

Hence 

r  a  . 

1  «  . 

W<*0 

„  jl  r 

tfiel 

£ 

£ 

ve  L 

7  J+ 

or 

r  «  . 

N 

r 

N2  “| 

{n??+  L *  DJ5J"  Jf 


(6-30) 

(6-31) 

(6-32) 

(6-33) 


In  the  above  expressions,  it  has  been  assumed  (for  convenience)  that  R  has 
left-half  plane  poles  and  zeros. 

Equation  6-33  is  the  desired  result  since  it  shows  clearly  that  the  op¬ 
timum  transfer  function  must  retain  the  original  zeros  of  the  system. 

The  procedure  outlined  above  also  demonstrates  the  feasibility  of  min¬ 
imizing  the  integral  expressions  by  solving  for  the  optimum  control  expressions 
rather  than  for  the  optimum  transfer  function. 
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In  the  section*  which  follow*  several  examples  will  be  be  given  to  dem¬ 
onstrate  the  application  of  Equation  6 -31  and*  more  specifically*  how  one  spec¬ 
tral  factorizes  the  expression 


,  t  . 

K  t  (VW 


(6-34) 


It  is  interesting  to  note  that  one  usually  tries  to  find  only  the  optimal 
transfer  function  or  optimal  control  expression  in  the  single  variable  case.  The 
compensating  network  required  to  force  a  particular  optimal  control  is  usually 
ignored.  Apparently  the  feeling  is  that  the  compensation  can  be  realized- in  a 
variety  of  ways.  While  this  may  be  true  in  the  single  variable  case*  one  is 
forced  to  admit  that  the  more  complex  multivariable  case  is  something  else 
again*  One  of  the  most  important  tasks  of  the  multivariable  theory  is  to  spec¬ 
ify  the  "feedback  gains"  which  compensate  the  open-loop  systems. 


6. 4  EXAMPLES 


and 


For  the  first  example  one  supposes*  in  Figure  17*  that 

s(7s*t) 


a  step  input. 


(6-35) 

(6-36) 


Substituting  into  Equation  6-29* 

gives  ® 

(&*(-**  s‘+  f)-  T*s#*  /))+ 

-i  JfuTJ)  =  V  <6"37> 

Therefore 


Y  = 


(i'r's'-ftW+Ays**#*}* 
sfrs*  i) 


(6-38) 


To  spectral  factorize  the  numerator  of  Equation  6-38*  one  observes 
(Ct  s *  +  Ci%*Cg)(Ct  s*-  C9  8*C9)  *  0^8*-  (cf  m2CfC$)s*  +  Cj*  (6-39) 

Equating  coefficients  between  Equations  6-38  and  6-39  gives 

C-  '  ^  ,6-40, 

0,  •  K 

Ct  • 
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Equation  6-38  reduces  to 

y  _  {(Cfsi+£ts  +  G$XGi9*~Cts  *■  ^j)]*  C,$x+Cz*  +  C9 


t/r«A  il 

”i  -  -  -  • t 


*/y •  ^  rt 

*  -  -  •  /• 

The  expression  for  the  optimal  control.  Equation  6-31,  becomes 


(6-41) 


ao  ~ 


ttTsi-t)  " _ id  (-a  9  *  f) 

(C,8*  +  Ct  9+09)  l_  S (e,8*- Cts +C9)  + 


(6-42) 


In  Equation  6-42,  the  only  pole  which  contributes  to  the  partial  fraction 
expansion  is  the  one  due  to  the  step  input,  since  the  poles  of  C, s*-  Ct  a  are 
in  the  right-half  plane. 


Therefore: 


- 


i  (Tt+l) 


T  *(-a9+0  I 

Lc(5*-^s^^J  Sa0 


Cft*+  C%  *  *  (Jj  ® 

i 

(rsf  0 

jot  — . —  "■  -  -  ■■ 

Cf***£ts  f<J, 

The  optimal  transfer  function  is  then 

f  T$±t  t£(a9±t) 


(6-43) 


F.  *■  —  U>  W  =  3  — 

n  *  c,$*  +  cts  +  a9 

td(&9  +  t) 


(6-44) 


Cf  S*  4Ct8*Cn 


It  is  easy  to  see  that  the  closed-loop  poles  migrate  towards 

3*  -oo,i  (6-45) 

as  the  error  is  weighted  more  and  more  heavily  (i.e.,  as  k*  -*»  0). 

From  Figure  17,  the  expression  for  the  compensating  network  is  found 

Fo 


to  be 


H, 


w  (1-FJ 


(6-46) 


Substituting  in  the  known  values  gives 

Ts  » /  __ 


WA 


C,  s  ♦  (Qt  -  £a) 


W3 


S  4  1 


(6-47) 


84 


We  first  observe  that  is  not  a  pr  per  rational  polynomial.  As  k2 
(weighting  error  term  heavily) 


i»  «  r  ) 

(C, •*  0) s  ♦  [(Ct  •  ha)-*  o] 


oo 


0 

(6-48) 


That  is.  the  form  of  the  series  compensating  network  becomes  indeterminant 
from  the  optimal  control  viewpoint,  since  W&  *  oo  requires  infinite  control 
deflections  and  the  performance  index  no  longer  exists.  Under  this  condition, 
the  designer  may  try  a  different  type  of  compensation,  perhaps  a  feedback 
pain  compensating  network  or  a  combination  of  series  and  shunt  compensation. 
It  is  easy  to  see  that  leaving  the  specification  of  the  compensation  to  the  in- 
®*®JJ**y  °*  *“•  engineer  could  lead  to  serious  difficulties,  when  the  complexity 
of  the  problem  becomes  compounded  by  the  presence  of  many  output  variables 
and  many  control  variables. 


Since  the  transfer  functions  which  describe  aircraft  usually 
tain  a  free  l/s  term,  the  second  example  will  deal  with  the  system 

wi»  -  J&ni 

os*  *a  s+t 


do  not  con- 


(6-49) 


and  the  step  input 


K  * 


? 


The  example  yields  results  that  lead  to  some  interesting  questions. 
One  now  finds 

Nth-klVV  -  lclbts*-(k£ta.t+lctct- 2k*b)3l+  (ft* 

* (e, s  *  *  c% s  *  as)(a, s*-cts  +  c9) 

After  equating  coefficients, 

C,  •kb _ 

Qt  'fH*I*7I*Z*  ~  *  Ikbjj&l?  ' 

09  *  + 


(6-50) 


(6-51) 


(6-52) 


The  expression  for  the  optimal  transfer  function,  Equation  6-33,  is  then 


s[kt(a.S4f)]  r 

(kb**  +  Cg3  [~ 

K(a.9+  /) 


t) 


■i 


(6-53) 
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From  Equation  6-53,  one  observes  that  the  gain  constant  for  the  optimal 
closed-loop  system  is  not  equal  to  unity  and  only  approaches  unity  as  k2— 0 

( heavv  we  iahti na  nf  fh*  TKa  imnUnstinn  ♦V'af  «««♦*«] 

*  «-v  17  - - - - *  ‘  — —  -  — ■  -  T*****  ^ 

theory  cannot  design  a  closed-loop  system  with  zero  steady  state  error  for  a 
step  input  unless  the  free  elements  have  an  integrator.  This  is  a  serious  dif¬ 
ficulty  from  the  viewpoint  of  the  control  engineer  who  designs  stability  aug¬ 
mentation  systems  for  aircraft. 


A  second  difficult  point  is  encountered  if  one  substitutes  Equation  6-53 
back  into  the  performance  index,  Equation  6-11. 

J* 

jj.t'ji  -  f  [m-l\[Fh)-i\nwMds 


jao 

_±L  f  . 

+  2ffj  J 

*  -  IO# 


W(  9)  W(-s) 


(6-54) 


Both  J)  and  -+■  oo  .  That  is,  the  performance  index  no  longer  exists  and  a 
question  as  to  the  validity  of  the  design  procedure  is  raised.  In  Equation  6-54, 
J,  oo  since  F(s)  -  1  has  no  free  s  to  cancel  R  =  1/s.  Jz-~oo  because 
F(s)  /  W(s)  has  no  free  s  to  cancel  R  =  l/s.  That  this  is  truly  the  situation  is 
obvious  since  the  error  is  finite  and  this  in  turn  requires  a  finite  control  ef¬ 
fort  for  all  time.  These  two  difficult  points  will  be  considered  in  the  next 
sections. 


6.  5  THE  PROBLEM  OF  A  TYPE  ZERO  PLANT 

As  was  seen  in  the  preceding  section,  when  the  fixed  elements  are 
type  zero  and  a  step  input  is  assumed,  the  performance  index  no  longer  exists. 
Hence,  although  the  procedure  yields  a  design,  it  is  impossible  to  verify  that 
it  is  an  optimum  one.  However,  it  can  be  verified  that  the  optimal  design  pro¬ 
cedure  yields  a  system  which  minimizes  the  steady  state  value  of  the  integrand 
of  the  performance  measure.  This  implies  that  it  designs  the  system  with  the 
highest  possible  position  constant  ( l€p)  consistent  with  minimizing  the  integral 
square  value  of  the  control  effort.  Thus  we  conclude  that  the  method  is,  at 
the  very  least,  heuristically  sound. 


We  now  proceed  with  the  proof  that  the  F0  ($)  yielded  by  the  design  gives 
a  steady  state  value  for  (e2  +  k2u2)  that  is  a  minimum. 


From  Equation  6-32, 


r»W 

one  finds 

F0(0) 


when  R  =  1  /s. 


/ 


JL 

m* 


(6-55) 

(6-56) 
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Since  eft)#*' fF-OC]  and  u(t)*X'f[fre/v]  •  we  may  consider  the  expression 


when  R(s)  =  1  /s. 


Expanding  each  term  in  a  partial  expansion  gives*. 

]■? }  -  LpM  e1,.0  r'[f]  *••• 

«-'/£&»  .  l)  arT-il,.... 

( W(s)  s  J  w/s)  I  *■©  L 5  J 


As  t  -*■  oo  ,  we  obtain 


[F(0)-l]  =  e(<x>) 

F(0)Jy/(0)  =  U.(oo) 


Therefore  the  steady  state  value  of  (e2  +  k2u2)  is 


M-.r-i*  f^r 

[w(o)\ 


(6-57) 


Differentiating  with  respect  to  F (o)  and  setting  the  resulting  expression 
equal  to  zero  then  gives  the  value  of  F(o)  which  gives  the  minimum  steady 
state  value  for  the  integrand  of  the  performance  index.  Performing  this  oper¬ 
ation  gives 

!  Ff0)  “  : ;  zsr  a-sei 

1  *  \J(o)1 

which  agrees  with  Equation  6-56.  Equation  6-56  was  arrived  at  by  using  the 
equations  for  the  design  of  the  "optimum"  system. 

6.6  PROBLEM  OF  OBTAINING  A  "GOOD"  LOW  FREQUENCY 
RESPONSE  WHEN  NO  FREE  INTEGRATOR  APPEARS 

The  problem  of  obtaining  a  closed-loop  system  with  a  zero  steady  state 
error  response  to  a  step  input,  when  the  plant  has  no  free  l/s  term,  is  now 
considered.  The  answer  to  the  question  of  whether  or  not  the  optimal  design 
procedure  can  design  such  a  system  is,  surprisingly  enough,  a  simple  one. 

The  optimal  theory  will  design  such  a  system  if  one  properly  defines  the  per¬ 
formance  index. 


This  conclusion  is  a  reasonable  one,  because  one  may  argue  that  such 
a  linear  system  can  be  designed  without  optimal  control  theory  by  simply 
"calibrating"  the  system  beforehand.  Now  every  linear  system  is  an  "optimum" 
one  for  some  performancejindex,  so  we  may  argue  that  there  is  some 


8Y 


wm, 


W 


tin  i«4 


performance  measure  which  will  be  a  minimum  for  this  system  which  has 
been  calibrated  to  have  zero  steady  state  error. 

6.  7  THE  PROBLEM  OF  THE  FREE  INTEGRATOR  USING 
S.  S.  L.  CHANfS'S  APPROACH 

To  prove  the  assertions  consider  the  problem  of  finding  the  control 
which  minimizes  the  performance  index  of  Equation  6-59  when  one  is  given 
the  system  in  Figure  18. 

oo 


*  ct  *t)*  *  rujot 


(6-59) 


*1 


^ _ - 

We 

u 

W 

Figure  18.  Single  Output  Optimal  System 
Applying  Parseval's  theorem  to  Equation  6-59  yields 

i°* 

Tin  /  [?  (Q1  - ct  "  ai *t) *  ru al dt 


where 


*  X,(s)  ,  f-s) ,  etc. 

Observe  that 

*t(s)  -  W.(s)u(s) 


(6-60) 


(6-61) 


It  is  assumed  that  the  transfer  function  describing  the  fixed  elements  of  the 
system  has  no  free  1/s  term.  That  is» 


W(t) 


H(at sn  *  a.f$n’i  +  *..  +  () 


■0  - m  s  m‘  *+  . . .  *  1 


fe. « "•  f 


where  m  >  n. 


We  may  write  Equation  6-60  in  the  following  manner: 

-y-  =  -~r  /  [ten, - 0, Wu.)(0,S, -aty)ij,  L.uU^  de 

J  -jeo 

Note:  r/q  is  equivalent  to  the  k2  of  the  preceding  section. 


(6-62) 


(6-63) 
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One  now  follows  the  usual  procedure  of  substituting 

U"U,  *  Xu, 

into  Equation  6-63  and  solving  for  the  optimal  control 
prccc-uro,  Olio  can  express  Equation  5-63  in  the  form 


(6-64) 

Carrying  out  this 


y-» 

where 

^  *  2irj  [("g"  *  &.6- Ct  Cs  j  Utcf9 

J  m 

T‘m  Wj  1  [(f  »*)“.- e,c.tf>*,]  a,  a, 

^  ‘  J57  /  [ff 


(6-65) 

(6-66) 

(6-67) 

(6-68) 

(6-69) 


•ufficien/coiidltlon  for^V/q  S  U  U  ^  H“C-  t,“  ' 


Jft  •  0 


This  is  equivalent  to  saying 

(j  *  ^  j  ^  W 


(6-70) 

(6-71) 


must  be  analytic  in  the  left-half  plane.  The  solution  to  Equation  6-71  is  (by 
direct  comparison  with  Equations  6-28  and  6-31):  ^ 


1 

C,  Qt  C?  «, 

m 

\f*cfw9 

m 

n 

*  m 

as 

The  optimal  transfer  function  relating  xt  to  %,  is  then 


(6-72) 


**  _ 

C,  C%  ft  1 », 

*1  '  * 

♦ 

.1 

■J  ♦  c*  * 

L*  5  J 

m 

(6-73) 
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(6-74) 


For  the  special  case  where  is  a  step,  i.e. 


V.  *  — 


A  -  73 

C,  Ci  W(o) 

1 — 

3? 

:-t 

i _ 

«« 

-%+c?  way 

C%  Cf  W*(o) 

J  *  Ctl  W*(o) 

If  ..a  assume  Cj  =  1,  we  then  should  pick 


Cf  *  /  *  —  •  — i — 

1  *  WVo) 


in  order  that 


Is 


s  1.0 


(6-75) 

(6-76) 


6.8  EQUIVALENCE  BETWEEN  THE  TIME  DOMAIN  STATE  VECTOR 
APPROACH  AND  THE  FREQUENCY  DOMAIN  APPROACH 

An  equivalence  exists  between  the  state  vector  approach  of  Kalman  and 
the  frequency  domain  approach  of  Chang.  The  nature  of  this  equivalence  is  best 
demonstrated  by  an  example.  For  the  example,  we  optimise  (in  the  time  do¬ 
main)  a  second-order  plant  to  a  step  input,  to  show  that  it  is  possible  to  obtain 
a  control  system  whose  steady  state  gain  is  unity,  even  though  no  free  inte¬ 
grator  appears  in  the  plant.  Thus  the  results  of  this  section  can  be  compared 
directly  to  those  of  the  last  section.  In  addition,  the  approach  used  to  include 
the  input  in  the  set  of  first-order  differential  equations  is  a  general  one  that  will 
be  given  a  more  formal  basis  in  the  section  on  "Model  Following"  (Section  7.  7). 

It  is  possible  to  express  a  deterministic  input  in  the  form 

*i  *  F'r 

where 

-  state  variables  of  the  input 
Fz  -  constant  matrix. 

The  plant  can  be  expressed  in  the  form 

where  *  Ft  *f  “/ 

=  state  vector  of  the  plant 
“  plant  system  matrix 
<&t  -  plant  input  matrix 
=  plant  control  vector 


The  input  and  the  plant  can  be  combined  into  a  single  representation 
and  the  combination  can  be  optimized  (see  Equation  6-77). 


(6-77) 


Now  assume  a  step  command  input  is  applied  to  a  closed-loop  system 
which  has  the  open-loop  configuration  shown  below. 


(1 

1 

Figure  19.  Block  Diagram  of 
The  step  input  can  be  described  in  the  form 

Xf  m  1  ,  Xf  «  0 


The  plant  becomes: 

-  * 

i 3  -  -b%t  +  u- 


The  entire  system,  consisting  of  input  and  plant,  becomes: 


(6-78) 


Suppose  we  decide  to  minimize  on  the  difference  between  the  weighted 
’'output",  ?  a  ,  and  the  weighted  step  input,  "X,  .  Choose 

(f-C, t,;  H  =  [C,  -Cz  o]  (6-79) 


where  C , 
Let 


and  Ct  are  constants. 

«]  *  r 

Q]  *  q 


r  and  q  are  scalars 


The  performance  index  is 


ZV  *  f  Fo  IQ.il.-  t  fu^dt 


t  r  i  f  r 

0 


/4_an\ 


Substituting  the  H,  Q.  R.  F  and  G  matrices  into  the  matrix  Riccati  equation 
(refer  to  Section  3. 2): 


pm  PF  <‘F'P‘PGV’tG,P+H’QH 


yields  the  expressions: 

j-l 

•  T«  a  n  t 

-*«  —  +9  “t 


(6-81) 


(6-82) 


-A.  *  -*V«  -  -  0,0,  t  (6-83) 

-A,  •  <*-“> 

-A.  -  - 2kf„  (6-85) 

'■Pm  *  ft, -  *P»»  ' feP.j  -  <6-«‘> 

-P„  *  -  2 “Pm  -  -2?  (‘-87) 


If  one  now  solves  for  the  values  of  the  steady  state  gains  using  the 
expression 


ct-  Gie-'a’p 

it  is  seen  that  the  gains  of  interest  are 


"I 

*3 


_fu_ 

r 

fll 

f 

J2»l 

r 


The  over-all  system  is  shown  in  Figure  20. 


(6-88) 


(6-89) 
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Figure  20.  Feedback  Configuration 
The  transfer  function  is 

_ ~  _ 

+  +  +■  t7  « 7~ 


/  s  y 

W#t) ' 

y  b  *■  Mi  J 

(6-90) 


The  remaining  task  i.  ,o  .elect  value,  of  U,  .  K,  .  and  U,  that  will  yield 

,  (6-9D 

* i  ss 

and  are  consistent  with  the  set  of  Equations  6-82  -  6-87. 

Let  us  first  observe  that  the  desire  to  have  constant  steady  state  gains 
f  fefa  ,  *&d  fc',  requires  in  turn  that 

•  *  •  (6-92) 

as  t  oo  .  Thus  it  is  necessary  that  Equations  6-84.  6-86  and  6-87  be  set 
eaual  to  zero.  If  Equation  6-84  is  set  equal  to  zero,  then  ~pn  must  be 
stant.  Thus  jpn  is  necessarily  equal  to  zero  and  this  forces  Equation  6-83 

to  equal  zero. 

In  a  like  manner,  the  fact  that  Equation  6-86  i*  equal  to  aero forces 
us  to  conclude  that  f*M-0a«t  —  «>  .  Thus  Equation  6-85  must  also  be 

set  equal  to  zero. 

We  next  observe  that  Equation  6-82  is  an  identity  and  is  thus  always 
.a.,.fiJ,  rcg.rdU..  o£  S  va?u«  c£  4>„  and  can  be  .afely  occluded  from  the 

set  of  dependent  equations. 


If  one  solves  Equation  6-85  for  ,  Equation  6-83  for  and  Equa¬ 
tion  6-87  for  ,  the  resultant  expressions  will  satisfy  all  the  Equations 

tt’irnuflrh  #i-R7. 

V 


Applying  this  procedure!  one  finds  the  following  expressions  for  the 
steady  state  feedback  gains: 


*1 
^ * 


'•OfCg  *fr 

(6-93) 

/**  *  V  9/r 

-  b+j bz  +  %fr 

(6-94) 

-a*  jat-zb  +  zjb* +Qt*  fyr 

(6-95) 

The  natural  frequency  of  the  system 

and  the  damping  by  the  expression 


*  a 


/  »*-»*  **fi**OtVr 
*  Jl  /b‘*  <3.‘  «/r 7 


ri 


(6-96) 


(6-97) 


From  Equations  6-96  and  6-97,  one  observes  that  the  natural  frequency 
and  damping  are  independent  of  the  parameter  C,  .  On  the  other  hand, 

—  =  -r . 7;-  (6-98) 

*i  tt  b  + 

-  (6-99) 

bt+G%tVr 


Thus  the  steady  state  value  of  being  a  unit  step)  is  directly 

proportional  to  6t  and  we  can  always  force 


For  example,  let  C*  =  1 . 

Then:  „  _  -a,  fjr 

-  -**/*»*  Ji? 

U,  =  i/P  1 


(6-100) 


Ci =  J b*  +■  9A* 


X  -  - 
*  2 


l2  Sf 


/  4*- 2** 

Jb2*  9/r' 

C, 

(r/*  *>*  -  0 


(6-101) 


Therefore  let 


Cf  -  1  + 

2l 

*» f  *« 


^  6Z 


(6-102) 


That  is,  the  steady  state  error  -  0, 

Observe,  from  Equation  6-97,  that  as  9/#*  00  *  the  damping  ap¬ 

proaches  .  707  regardless  of  the  value  of  0g  . 

Notice  that  the  choice  of  6t  =  1  and  C f  =  f*(*’/^)b2  gives  us  the  same 
pole 8  of  the  optimal  system  as  one  obtains  using  the  performance  index: 


2 Vmf  [tfa-Ki)2 


(6-103) 


Only  the  steady  state  gain  constant  is  different. 


Letting 


give  8 


In  the  previous  section  we  obtained  in  Equation  6-75, 

T  w*m 

1  V  -  1 — - T 

S2  *  A  s  *  b 


Therefore 


w»-f 


This  result,  obtained  using  the  frequency  domain  approach,  agrees 
with  Equation  6-102.  The  frequency  domain  answer  was  obtained  in  closed 
form  (i.e.,  in  terms  of  the  transfer  function)  while  the  time  domain  answer 
comes  out  in  terms  of  the  various  matrix  entries. 

As  another  example,  suppose  it  is  required  that  ct)n  -  constant.  F rom 
Equation  6-96, 


95 


pick 


=  *>«  «  J  bz  +  GS  %/r 

Mr 

If  we  continue  to  require 

»*  s  /  s  3*  */r 
*f  ts  ”  b**Vr 

then  pick 

*  JMr  (vJot-b*)' 

Using  these  values  of  C,  and  gives 

*  ~<4)Z 
ldl  »  a)az -  b 

m  - &  *  J<L*+  2((4>* - b) 


and  a  damping  ratio  of 


1  \  ~  f£ 

2  (  a*1  / 


Thus  £  =  .  707  when  0)a  >>  b.  The  system  is  given  in  Figure  21 


Figure  21 .  Closed-Loop  Configuration 
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SECTION  7 

MINIMIZATION  in  the  frequency  domain  - 

THE  MULTIVARIABLE  PROBLEM 


7. 1  INTRODUCTION 

In  this  section,  the  frequency  domain  approach  of  the  previous  section 
is  extended  to  the  multivariable  case.  The  development  is  one  which  preserves 
the  state  apace  notation  as  much  as  possible  but  draws  on  the  frequency  do¬ 
main  approach  of  Chang  for  the  basic  analysis  tools.  It  is  shown  that  the 
frequency  domain  equation  of  interest,  which  was  a  scalar  equation  in  Section 

6,  becomes  a  matrix  equation  of  the  Wiener-Hopf  type.  This  equation  is 
solved  by  two  methods: 

1.  spectral  factorization,  or 

2.  a  direct  method. 

Examples  are  given  to  demonstrate  both  approaches. 

A  subsection  is  included  to  show  how  one  arrives  at  the  matrix  Wiener- 
Hopf  equation  when  the  basic  description  of  the  system  is  given  in  terms  of 
transfer  functions  rather  than  a  set  of  first-order  differential  equations. 

The  section  concludes  with  a  theoretical  development  of  a  method  which 
uses  a  mathematical  model  to  describe  a  desirable  set  of  system  dynamics 
and  then  requires  the  plant  to  match  this  set  as  closely  as  possible.  Specifi¬ 
cally,  the  model  is  included  as  a  prefilter  ahead  of  the  plant  and  the  object  of 
the  design  is  to  move  the  plant  poles  to  those  regions  of  the  s  plane  where  they 
will  not  interfere  with  the  model  poles.  Examples  are  given  to  illustrate  the 
basic  character  of  the  results  obtained  and  to  demonstrate  how  one  uses  the 
optimal  control  law,  u0  »  -&%  ,  to  synthesize  a  specific  closed-loop  configuration. 

7.  2  THE  REGULATOR  PROBLEM 

Consider  the  time  domain  vector  equations 

H  • 

*  a  F%  + 

where  a(t)  is  a  vector  which  takes  into  account  any  inputs  to  the  system  (e.g., 
a  disturbance  input). 


(7-1) 


The  performance  index  is  written  as 

00 

2V-  J [y'M Qy(i) * uf(i) I2u &)] dt 

o 


Applying  Parseval's  theorem  to  Equation  7-2  gives 

It** 

ZVm  irF /  [y»Qy+a* eu} dt 
ymy(*) 


where 


§  =  y(-s) 

y'l-s)  a  transpose  of  the  vector  y(~s) 


(7-2) 


(7-3) 
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Taking  the  Laplace  transform  of  Equation  7-1  yields: 

y  =  *  A/pTs-  r]'f[x  (o)  *  a(s)] 

For  the  sake  of  brevity,  write 

y(s)  «  V/($)u(s)  +  B(s)[x(o)+a.(s) ] 

so  that 

y  =  W  H  +  B  [x  (o)  +  a  ] 

and 

%  *  ( qf  =  u,  W+  +  [ y'(o )  +  at]  S’* 


(7-4) 


(7-5) 


(7-6) 


(7-7) 


The  expression  for  y*Qy  becomes,  after  letting  8(f) (o) aJ.s)]  = 

-  Us  WiQWu  +  U'tytQS,  *  QWu  *  $UQB,  (7-8) 


Substituting  Equation  7-8  into  Equation  7-3  gives 
joo 


^u.tWiQ\rfu.  + BllfQWu+B1itQB,  +  ut  Zujds  (7- 

j  -joo 


9) 


We  now  seek  the  optimum  control  vector  which  minimizes  the  perform¬ 
ance  index  of  Equation  7-9#  Let 


U  *  U0  +  %  Uj 


(7-10) 


where  u0  is  the  optimum  component  of  u  and  Uf  is  any  arbitrary  control  vec¬ 
tor  which  is  analytic  in  the  right-half  plane*  Substituting  Equation  7-10  into 
Equation  7-9  gives: 

J°° 

2V‘  I  K W4QWu,,+uf' W,QBt  ^ fcajafe 


2JTj  ij 


J  K  K»  Q  Wu.,  +  &1+Q  Wu,  *  u,0*  TSuJds 

-J  — 

-II  U  Wi  Q  Wa,  *  u,4  W,  Q Bi  *  ulfl  TSuJds 


2jrJ  ", 


%i  /'J0* 

+ if-  /  ° ^  ds 

J  -jeo 


or 


ZV-  *(  ^  ♦**)+*'* 


(7-11) 

(7-12) 
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In  Equation  7-12*  J*  is  the  optimum  component  of  2V  while  T<y  is 
always  positive.  On  the  other  hand*  the  integrand  of  =  when  s  -8 
and  the  necessary  and  sufficient  condition  for  an  optimum  becomes  (see*  for 
example*  page  14  of  Reference  3); 

(7-13) 

The  relationship  of  interest  is 

*c  ’if  /  [V*-W0QW]wa*W4GlBt}ds  (7-14) 

J  -jo*  1 

Since  Uf  is  a  vector  which  is  analytic  in  the  left-half  plane*  the  con- 

di,ion  rc .  o 

can  be  expressed  as 

[12*W4QW]u.4  *  W4Q£  [*.(<>)  + a  (s) ]  =  ^(s)  (7-15) 

where  ^  (t)  must  be  analytic  in  the  left-half  plane. 

For  the  sake  of  compactness*  let 

C  -[ft+WtQW]-  e  +  C'  [ls-ry(G  (7-16) 

and 

J*  *  W,QB[v(o)  +  a(s)]*  G'l-Xs’F'fti'QUlls-  F]'f[*(o)+  a.(s)]  (7-17) 

Equation  7-15  becomes 

Cu4  +  (7-18) 

Equation  7-18  is  a  matrix  equation  of  the  Wiener-Hopf  type  which  can 
be  solved  in  two  different  ways.  The  method  to  be  described  first  requires 
the  factorisation  of  the  matrix  C.  The  second  approach  takes  advantage  of  the 
fact  that  the  closed-loop  poles  of  the  optimal  control  law  can  be  found  from  a 
scalar  equation.  Thus  one  need  only  solve  Equation  7-18  for  the  zeros  of  U.t  . 

Thus  far  the  solution  of  the  matrix  Wiener-Hopf  equation  for  the  opti¬ 
mal  control  vector  has  been  emphasized.  However*  one  may  solve  for  the 
optimal  output  vector  y0  under  the  special  condition  that  the  matrix  of  trans¬ 
fer  functions  is  invertible  (  exists).  A  necessary  condition  for  1  to 

exist  is  that  the  number  of  outputs  equals  the  number  of  controls.  When  W'( 
exists*  the  relationship  .  . 

yWu  +  8( 

can  be  substituted  into  the  matrix  Wiener-Hopf  equation  to  obtain  either 

vw-1  s  'J- 

or 
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w4  -  > 

as  alternate  expressions  in  terms  of  the  optimal  output  tj0  .  In  deriving  the 
above  result s,  it  has  been  assumed  that (ZY/-1)"*  «  • 

[ie*  k/,  f  u/*0S  c  ^ 

%m  w%*  3 
W'f[%-q] 

[iz+ w]  |y-' 5;]  ♦  w; oq »  ? 

»fw-f  $] +wsq  (%-%) + bw^r«  ? 

[l2W'-,+  K*0]9fo-  ^ 

lew'!  i  +  Ibw]*^]  t 


if  (1 ew-,j"/  =  wie-'f 

72U/-y|  i+W£-v,e  4^-bJ  “  f 


7.  3  FACTORIZATION  OF  THE  MATRIX 
From  Equation  7-16,  one  observes 

2#  -  fl2  +  WfQW],  « *8+  ty,  $  W«  g  (7-19) 

since  R  and  Q  are  symmetrical. 

Equation  7-19  is  the  defining  relationship  for  a  paraconjugate  hermitian 
matrix  and  we  are  assured  (Reference  8)  that  a  factorization  exists  such  that 

C(s)  -  VV-sJ  Y(s)  =  Y#Y  (7-20) 

where  Y(s)  is  rational  and  analytic,  together  with  its  inverse  Y~l,  in  the 
right-half  plane. 

Substituting  Equation  7-20  into  Equation  7-18  gives: 
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.  J-  .■ 


K  Yu  +  T  * 

(7-21) 

w  i 

or: 

where  V.  J*  mey  be  decomposed  into  the  sum 

(7-22) 

Y.-'J 

(7-23) 

in  which  the  first  factor  on  the  right  is  analytic  in  the  right-half  plane  and  the 
second  factor  is  analytic  in  the  left-half  plane* 

Substituting  Equation  7-23  into  Equation  7-22  gives 

Let 

(7-24) 

ut  •  -Y-'fcij]*.  (7-25) 

and  substitute  above.  We  then  have 

V.  [Y.-'J].  '  f 

which  is.  by  definition,  analytic  in  the  left-half  plane.  Thus  we  have  satisfied 
the  requirement  that  4.  be  analytic  in  the  left-half  plane  and  verified  that  the 
assumed  ut  is  the  optimal  control  vector. 

The  crucial  step  in  solving  for  the  optimal  control  vector  is  the  task 
of  spectral  factoring  the  matrix  C.  In  general,  this  is  a  tedious  chore  and  one 
must  resort  to  the  algorithms  given  in  References  8  and  9.  The  algorithm  of 
Reference  9  permits  one  to  draw  some  immediate  conclusions  concerning  the 
form  of  the  optimal  control  law  and.  when  used  in  conjunction  with  other  known 
facts  about  optimal  systems,  gives  an  indication  of  the  amount  of  superfluous 
work  required  in  the  factorization  approach. 

From  Reference  9  one  finds  the  first  step  in  factoring  C  to  be  the  one 
of  obtaining  a  least  common  denominator  for  all  the  entries  of  C.  This  step 
becomes  trivial  in  view  of  the  fact  that  all  the  transfer  functions  derived  from 
a  set  of  equations  have  the  same  poles.  The  least  common  denominator  is  the 
polynomial  in  s2  which  defines  the  open-loop  roots  and  the  conjugate  of  the 
open-loop  roots.  That  is. 

0  »  H  +  VJiQW  -  A  (7-26) 

where  A  is  a  p  x  p  matrix  which  contains  only  polynomial  entries  (as  opposed 
to  the  rational  entries  of  R  +  W*QW)  and  D  is  the  characteristic  polynomial  of 
the  open-loop  system* 
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Reference  9  further  assures  us  that  a  factorisation  exists  such  that 


A  A  a 


whcf o  and  Ai  havs  nniv  nniirnAmjAi 

of  simplicity  of  Dresentstian  *iT.Vn  •.  ?““"** ,  “  wo  M»»me,  tor  the  sake 

seen  that  Y  pre8entation»  th*t  D  is  analytic  in  the  right-half  plane*  ,  it  is 

y-[id-']a, 

i 

y,  -  [uer'iA,, 


(7-27) 


Now 


Y-f  =  loa;'  = 
V*  (lS)AfJ  « 


IA,I 

Kt 


(7-28) 


(7-29) 


abhTs^and^  «(/*  h^^ain  whe'e  p  is  e9uai  to  the  number  of  control  vari- 
theVbove  expressions*^^1  *  m\*iX  wiJh  .polynomU1  entries.  Substituting 
(Equation  7-25)  gives:  equation  which  defines  the  optimal  control  law 


_  _  idIaM  f  zUAtf4i  1 


(7-30) 


s-r  -  isvwss  Eft  t  con.r- 

pans  Ton 

nnUg  0f  ./-f  \  T.  #  ® ^  polo,  of  the  open-loop  ey.tetn  and  the 

E  form  ’•  Th“*  *"  v*riou*  “»PO»n*«  ofEqnktlon  7-30m"”i  of 

Ug.  *  ^  ^ 

(tt*.L  At)  (LHP  pot**  of  W+Qty  I 

Uct  *  — - 9m<») _  (  (7-31) 

(ditAi)(LHP p*te>$  of  kfoQBf)  f 

a  m  4  (») _  I 

_ 2  (4e*  At)(LHPpoto,  q/  IhT^T~  J 

Wh«  D  hu  both  right-  mod  l.ft-h.lf  pUn.  pel...  on.  u...  th.  .*pr...lon. 

{vB}*  and  [j>D]m 

«ot”’  i0r  *X*mp1*’  ,h*  (  I* indict.,  th.  u..  of  only  th.  l.ft-hnlf  pUn. 


In  Equation  7-31,  %01  ,  jfct  ,  ...  X on  are  the  polynomials  which  result 
when  the  partial  fraction  expansion  entries  of  th*  left-half  plane  poles  of 
W9QB1  ,  having  been  collected  over  a  common  denominator,  are  multiplied 
by  (~ZD)Af  *4  . 

It  is  now  desirable  to  obtain  a  relationship  between  the  roots  of  |4t/ 
and  the  roots  of  the  multivariable  root  square  locus,  which  are  defined  by  the 
rational  polynomial  equation  (refer  to  Equations  3-26  and  3-29)* 

\K+W,,QWl-0  (7-32) 


This  relationship  will  give  some  indication  of  the  superfluous  effort  involved 
in  the  factorisation  approach  since  the  left-half  plane  roots  of  the  roof  square 
locus  have  already  been  shown  to  be  the  only  poles  of  the  closed-loop  system 
(refer  to  Section  3.  2) . 


But 


Ag 

vv 


(7-33) 


where  A  defines  left-half  plane  roots  of  the  root  square  locus.  Therefore 


|A,|  -  AT/*'1 

Utf  ,  for  instance,  in  Equation  7-31,  would  have  the  form 


D^A  (lMP  pole*  &(a}) 


(7-35) 


In  Equation  7-35,  we  have  extracted  the  D  that  would  result  from  the  partial 
fraction  expansion  and  lumped  it  with  .  Since  it  is  already  known  that 

an  open-loop  root  is  not  a  closed-loop  root  it  must  be  that  contains  the 

factor  D *  .  Thus,  for  example  (in  the  regulator  problem),  three  out  of  every 
four  roots  resulting  from  the  factorisation  process  must  cancel  when  there 
are  three  controls  (p  =  3). 


If  we  agree  r*(s)  =  left-half  plane  poles  of  a(s)  and  that  has  already 
been  cancelled  out  of  (s)  ,  then  the  components  of  can  be  written  in 
the  compact  form: 

(*> 


u 


»on 

Ar 


(7-36) 


where  (*)  is  a  polynomial  of  at  least  one  order  less  than  AP  .  Thus  all 
the  poles  of  the  optimal  control  are  known  both  from  inspection  of  the  root 
square  locus  and  the  a(s)  input  vector.  This  fact  can  be  used  to  good  advan¬ 
tage  to  solve  for  ut  directly,  without  factoring  C.  The  discussion  of  this 
application  is  postponed  to  Section  7.  6. 
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****'<i^  r: 


One  advantage  of  this  procedure  is  apparent.  It  is  seen  t^at  the  fac¬ 
torization  is  independent  of  the  input,  since  the  a(s)  vector  is  contained  only 
in  the  J  matrix.  Thus  there  are  no  additional  conceptual  difficulties  when 
there  is  an  input  to  the  system  since  the  difficult  portion  of  the  over -all  prob¬ 
lem  is  the  factorization  of  the  rational  matrix  C. 

In  the  next  section  it  will  be  shown  how  one  can  formulate  multivariable 
problems  directly  in  the  frequency  domain  after  which  an  example  will  be  given 
to  illustrate  the  steps  involved  in  solving  Equation  7-25.  The  example  is  a 
contrived  one  which  permits  the  factorization  of  the  C  matrix  by  inspection 
(i.e.,  the  R  matrix  is  singular). 

7.4  DIRECT  FORMULATION  IN  THE  FREQUENCY  DOMAIN 

IN  TERMS  OF  TRANSFER  FUNCTIONS 

One  often  has  the  basic  information  concerning  a  multivariable  system 
given  in  terms  of  transfer  functions  rather  than  F  and  G  matrices.  In  this  case, 
it  is  often  advantageous  to  formulate  the  problem  directly  in  the  frequency 
domain. 


Given  the  performance  index 

j°° 


2v/=  7/F"/  Uf'Qujds 

J  -j » 


and 


y(s)  ~  W(s)  u(s)  +  2?  (s) 

one  can  proceed  directly  to  the  equation 


[w*QW*1i]u>  +  W,QB  -  ^ 

for  which 

“o  - 

and  where 

c  ~  v  *  wt  q  w  =  y*  y 

j  «  W^Q  B 


(7-37) 

(7-38) 

(7-39) 

(7-40) 

(7-41) 


Note  that  it  is  not  necessary  to  think  of  y(s)  as  being  defined  in  terms  of  F 
and  G  matrices.  That  is,  given  Equation  7-37  and  a  y(s),  we  may  proceed 
directly  to  the  matrix  Wiener-Hopf  equation  (Equation  7-39).  The  factoriza¬ 
tion  example  of  Section  7.5,  the  illustrative  example  of  Section  7.6,  and  the 
model-following  derivation  of  Section  7.  7  should  make  this  point  clear. 

7.  5  FACTORIZATION  EXAMPLE 

Suppose  we  have  the  system  depicted  in  Figure  23.  There  are  two  in¬ 
puts  to  the  system,  Et  (s)  and  Ez  (S)  .  Our  design  objective  is  to  minimize 
the  difference  between  the  actual  system  output  and  some  desired  output 
E3  (s)  .  In  Figure  23,  the  transfer  functions  (s)  and  ufz( s)  represent 
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~si  att  j&js  ss 

*rindr«T  tW°TwT^:"t.*,H£,th'  °P,im*1  co*r^cioT£^r» 

Aift.,*  71  *••*•  *•}  r  ar®  not  P«ticularly  interested  in  what 

into  thl °n*  1  fc'  i9)  and  W  )  •*•  «ince  they  do  not  enter 
into  the  problem  until  the  compensating  networks  are  designed. 


Figure  23.  Block  Diagram  of  System  with  Two  Controls 
and  a  Single  Output 

The  performance  index  is 


tVmf{¥*+fa*t  +r2ut)z)dt  =  J  I#**  [u,  ut) 


r  ft*  r,rt 

.  *-trt  r*  J 


u, 


a 


■a- 1 


From  Figure  23,  we  see 

y(*)  -  -E9(9)+ur,u,  +urz  uz  - 

which  is  a  scalar. 

Equations  7-42  and  7-43  tell  us  that 
3  s  1  (a  scalar/ 


tl, 


L  Ut  J 


IV  -  [«r,  «rt]  ,  * 


«/ 


a  J 


®  =  (a  scalar) 


dt 

(7-42) 


(7-43) 
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Substituting  the  above  expression  into  Equation  7-39  gives 


UT, 


us2 

\  U  J 


fa 


r,1 


or  r~ 


r,~*ur,ur,  rt  r+ur,ur2 

rt  rt+urxur,  rf  *  ufx  ar2 


nr2 


u>0 


(60* 


1) 

V 

* 

ur, 

r*i 

J  J 

“°2. 

\J-2_ 

Ej  UTl 

e,  syt 


Therefore,  C  in  Equation  7-41  is: 

*t*  *ur,urf  fm1^t^urzur1 


or 


c  = 


c  = 


*1  r2  *  &2  *>1 


rzz  +  urt&t 


V  = 


% 

'll 


~  E3  “fz 


(7-44) 


(7-45) 


n  r2 
ur,  ur2 


=  Y>Y 


(7-46) 


In  factoring  C  we  have  assumed  W,  and  UT2  are  transfer  functions  with 
left-half  plane  poles  and  zeros.  Applying  Equation  7-40,  one  finds 


u.„ 


U-r 


'z  J 


rturt) 


or 


~  ^2  -rZ 

~&z 

-ur,’ 

-ur,  r t 

“*a 

m. 

n 

-Ejur2 

(rf&2-  rz&,) 


*0, 


U0i 


v2  -rt 

-  £,  u r2  a/,  +  e5  ur,  urz 

-uri  r. 

E3  r2  Sr >  -  E,  rf  uYz_ 

(Yfarz~  rturt) 


(nv2  -  r2  or,) 


(7-47) 


After  simplifying  Equation  7-47,  assuming  E3  (s)  has  only  left-half 
plane  poles,  one  finds 


tc, 


-rz  E,  (s) 


°i  = 


U-„  - 

°2 


r,ur2  (s)~  r2  ur,  (s) 
r,Ey(s) 


r,ur2  (5)-rzarf  (s) 

|For  this  example,  the  root  square  locus  expression  becomes 

I  £  +  wxqw\  =  (r,  urz  -  r2  urt)(r,  ur2  -  r2  ur,)  =  o 


(7-48) 


(7-49) 
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One  can  also  verify  that 


'ii 

0 

ti 

m 

0 

(7-50) 


7. 6  A  DIRECT  SOLUTION  OF  THE  OPTIMAL  CONTROL  LAW 

.  u  4 

In  this  section*  the  matrix  Wiener-Hopf  equation  (Equation  7-15  or 
7-18)  is  solved  directly  by  using  the  information  contained  in  Equation  7-36: 

to 


The  advantage  of  the  method  is  that  Cramer's  Rule  can  be  used  in  solving  for 
the  optimal  control  law.  The  technique  has  obvious  application  in  other  fields 
where  solutions  to  multidimensional  Wiener-Hopf  equations  are  required. 


Briefly*  the  procedure  is  based  on  the  fact  that 

(W»QW+B)ua  *■  W<Q8[t(o)+a(s)]  =  ^  (7-52) 

is  a  vector  which  is  analytic  in  the  left-half  plane.  Since  the  poles  of  u0  are 
already  known  from  the  root  square  locus*  we  may  assume  that  the  various 
components  of  the  control  vector  can  be  written  as  polynomials  (with  unknown 
coefficients)  divided  by  the  closed-loop  poles  (and  whatever  poles  that  may 
enter  due  to  forcing  functions  when  the  servo  problem  is  being  considered). 

One  then  substitutes  these  expressions  back  into  the  vector  equation 

*  W*  Q0f  -  (7-53) 

and  forces  a  common  denominator  for  the  components  of  consisting  of  all 
th»  left-half  plane  poles.  Since  sf  is  analytic  in  the  left-naif  plane*  it  must 
be  that  the  numerator  of  Equation  7-53  has  zeros  that  cancel  the  left-half 
plane  poles.  Thus  when  the  least  common  left-half  poles  of  Equation  7-53  are 
kaown*  it  is  only  necessary  to  let  s  t  ke  on  values  that  force  this  denominator 
to  aero.  Since  the  numerator  must  al"^  be  :  ero,  one  obtains  expressions  that 
are  equated  to  zero  and  yields  equations  in  terms  of  the  undetermined  coef¬ 
ficients.  There  are  usually  more  equations  than  unknowns  but  one  will  find 
that  the  correct  number  of  these  equations  are  linear  combinations  of  the 
others  and  one  is  left  with  n  linear  equations  in  n  unknowns.  Two  examples 
will  demonstrate  this  and  perhaps  make  the  procedure  clearer. 


Suppose  we  have  the  configuration  of  Figure  23*  and  it  is  desired  to 
minimize  the  performance  index 


tjz+r,uf*+rtu* 


(7-54) 


This  is  the  ame  example  used  in  the  previous  section*  but  with  a  dif¬ 
ferent  performance  index.  The  only  difference  lies  in  the  R  matrix*  which 


•frmfnr.  nr 


f 


for  this  particular  index*  becomes: 


L  o  rz  J 

Corresponding  to  Equation  7-45  of  the  previous  section,  we  have 


V,  i-  urt  ur1 

ur,  urz 

U*i 

~  ' 

&ZWi 

r“z  *  ufz  ur2 

_  t  1 

_^-3U/2  . 

The  root  square  locus  is  given  by 

r,  rt  +  urt  urt  *  rf  urz  &z  = 0 


To  demonstrate  the  technique  described  above,  let 


S  +  2 


=  7  S*1){S  +  3) 


^  (Sr1)(s+3) 

r  -  1 
rt  2 


r*  -  3 


The  expression  for  the  root  square  locus  becomes 

(s*/2,)(s^-/fQ7)(-s  ^/27)(,-S4-/7otJ 
6  (s*  f )(s+  j)(-s+ 1)(-  s *j) 

Therefore,  the  closed-loop  roots  are 

S  -  -JT  ,  -/»* 


Assume 


U.„ 


a.sz  +  bs  +  C. 


s(s  ■>■/£’  )(s  +  fio’) 

ds2  +  es  +  f 

'2  s  (s  7JT 

where  a,  b,  c»  d,  e,  and  f  are  unknowns. 

Substituting  into  Equation  7-57  gives 


:y&'i 

-a  . 


(7-55) 


(7-56) 


(7-57) 


(7-58) 


(7-59) 


(7*60) 
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("T“ *»a  («**ts  +e)+(-s*2)(ds2+e$+f)-(-s+2)(s+3)(s+l)(s+/I)(s*/io) 

($t-‘4s  +  JS)s(S4-  tX$+3)(S+/2f)(s+/fO^) 

(^2}(a9^j_bsjc^  (\m  ^r***4)^9****^**^**^** /*’)(*+#&) 
(9*-4S+3)*($+ 1)(9*3)(9+  J7)(s  +  /ft) 


sh 


(7-61) 


Since  /ft  and  are  analytic  in  the  left-half  plane,  it  must  be  that 
the  numerator  of  each  expression  is  zero  when 

S‘0,-1,  -Jio 

This,  of  course,  gives  ten  equations  with  only  six  unknowns.  However,  four 
equations  turn  out  to  be  the  same  and  we  are  left  with  the  set: 


8.5c  *  Zf  »  (tJJa 
Zc  +  4f  m  3/20 

L  J  11 

OL-b+d-  e  ■  -  -7=7 
J20 


j 


-  Za  +b+3d-e» 


1 


Jzo 


u>hon  s  •  0 

u>he»  s»‘i 
tv  he/)  s  -  -3 


'\ 


-  3c  +~p=;  b  +  (4  +  2/?)d-  (2+2fi)e 
</z 


-9 

/to1 

- 1.8 


-3a.*-jjjb.(4.2ji3)<l-(U-^)e*-j=! 


tohon  s  -  -/z1 
u)he#  s  «■  -  //o' 


J 


and 


U0i  = 


Uqj  * 

s(s  *J2)(s+ /Td) 

__  0.500375**?- was* 

%(**/?)(•+/?&) 

The  output  of  the  system, 

y  “  urf  u01  *  44  ^04 

is  found,  by  direct  substitution,  to  be 

0.93f4?S  *  2.4S97J 
^  ~$(8+/2?)(9+/iol) 


(7-62) 


After  using  Cramer's  Rule  to  solve  for  the  unknowns,  one  finds 
0.93147  S2  *  3.732  3  S*  tZ^ 


(7-63) 


(7-64) 


(7-65) 


This  concludes  the  first  example.  For  the  second  example,  a  situation 
in  which  a  multiple  closed-loop  root  occurs  will  be  worked  out.  This  example 
will  be  carried  out  in  greater  detail  since  the  manner  in  which  the  number  of 
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equations  reduces  to  the  number  of  unknowns  in  the  case  of  multiple  roots  is  not 
as  apparent  as  it  is  for  simple  roots  (real  or  complex).  For  illustrative  pur¬ 
poses,  this  example  will  be  formulated  from  a  "regulator 11  viewpoint  (that  is, 
the  F  and  G  matrices  will  be  specified).  Assume  the  matrices  shown  below 
are  the  given  description  of  the  system. 


1  0~ 

0  1  ' 

"  1  O' 

/  o‘ 

/  o' 

Q  = 

F  = 

£  = 

A/  = 

12  = 

J 

_  -3 

_0  1  _ 

_0  t _ 

_  o 

Therefore, 


and 


[Is-F] 


S  -1 

3  s  +  + 


W  ■  //[is-r]  _/6  = 


and  [Ts-P] 

Sf  4  1 

_-3  S_ 

S z+4s  +3 


“s+4  1 ~ 

j-3  S_ 

S2  +  4  5  +  J 


(7-66) 


and 


Hence 


W>QW  = 


s  +  4 

f " 

‘-SZ+2S 

4(-SH)~ 

-3 

5  _ 

.  4(*+t) 

-5 2W  J 

s4-/06z+9  s4-f0s2  +  9 

~S*-11s7  +  34  4(-s+i) 

4(5  4-/)  s  4~tfs2  +  f0_ 

s*-  10s2  +  9 


The  vector  expression 

[e  +  WxQw]ii0  +  W¥QB%(o)  =$(S) 

becomes 

[(s*-f/s2  +  34-jU"  *  4(- s*  +(-Sz+Z5)%0f  +  4(-S+ t)  ^2] 

_____  _  ^ 

+(s+-ttsz+fo)u.ot  /  4(s+t)%0f  +(-szH)%0 J 

s'*-  >-9  “  ^ 


(7-69) 


(7-70) 
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The  expression 


\G+W»QW\ 


S 4-  f2S7+36 


s* -  tOsz ■*  9 

shows  the  closed-loop  roots  to  be 

{ s*-t2,‘*3t.y » (s>jTf 


(7-71) 


Thus  the  expression 
yields 


a. 


in 


u 


on  &r 
a.S4-b 


Of 


(s+  JV) 


u „„  * 


cs+d 


2  >  ~02 


(s*/ry 


(7-72) 


Substituting  Equation  7-72  into  Equation  7-70  and  obtaining  a  least  common 
denominator  of  the  left-half  plane  poles  gives  the  expressions 


(s4-  11s*4  34)(aS4b)+4(-S4/)(cs+d)+[(-S*4  2£‘)*0,  *  4(-9+/)l60t'}(9+JF)* 


(sz~  43  f  3)(st  +  4s  +  3)(s+/r)z 
4(sn)(<is+b)4-($1- fts*4  to)(c$+C/)+[<t (S4  l)vot *(-Sl+  + 

(sl-  j77T)Js*74s7F)(s7/T)z 


=  yt(s)  (a) 

(7-73) 

=  %(s)  (b) 


Now  /jf  (s)  and  ^t(s)  must  be  analytic  in  the  left-half  plane.  This  is 
only  possible  if  the  numerators  of  Equation  7-73  contain 

(sz*4s*  3)(s  +  /<r)z  (7-74) 

as  a  factor.  Hence  the  numerator  of  both  equations  must  equal  zero  when 

S*  -JO  -3 

Now  consider,  for  example,  the  expression  for  (s)  which  is  of  the 

form 


This  implies 


N< 1,1 

D^TT/F)*  ft (5) 

(7-75) 

N,  (S) 

V,(.)  - 

(7-76) 

Differentiating  both  sides  of  Equation  7-76  with  respect  to  s  gives 


c/ti. 


n(  AR 


djh 

ds 


(7-77) 
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0.  Therefore, 


As  s  -  fk*  the  right-hand  side  of  Equation  7-77  — ► 


=  0 


era  as 

as  5  ■*  -  /iT  •  But  0  ,  therefore, 

0N,/ds  .  o 

as  5 «•►-/§"'  .  One  therefore  concludes  that  the  differential  of  each  numerator 
of  Equation  7-73  must  equal  zero  for  s  •  -/S1. 

We  now  proceed  to  sequentially  let  s  take  on  the  necessary  values  in 
Equation  7-73  (and  in  the  differential  of  each  numerator  of  Equation  7-73), 
and  investigate  the  linear  dependence  of  the  expressions  which  result. 


Let  s  =  - 1 , 

From  Equation  7- 73a,  -3a  *  3b- C  *-d  *■  ^  (7-78) 

From  Equation  7- 73b,  0(-a,  +  t>)  +  0(-C'  +cf)+  0  *  0 

We  now  have  one  equation  with  four  unknowns  (Equation  7-78). 


Let  s  s  -3. 

From  Equation  7 - 7 3a,  1(>(-3&+b)*-tL(-36+d)+ [ft  %0t  /  t6  %ot ] [ fT “ 3 J2  •  0 
From  Equation  7- 73b,  -  8(-3a,+b)~  8(-3C'+d) +  (-8%of- Qv02)[j&' -  3]2  -  0 

These  two  equations  are  linearly  dependent.  Hence  one  obtains 

-3&  +  b-3e+d  +  [#*,  +  ***][/«’  -»]#-  0  (7-79) 

as  the  second  equation  in  four  unknowns. 

Let  b  =  -  /IT  . 

From  Equation  7-73a,  4(-/F &+&)+  4(f+  ft?  )(-  JZ1  C *d)  mO 
From  Equation  7-73b,  4(f-  /T  )(- /&  a+ b)  -  20  (-  /61  C +d)  *  O 

These  two  equations  are  linearly  dependent.  A  third  equation  in  four  unknowns, 

-/51  &+b- (ft1  +  b)c> +(*+/? )d  mO  (7-80) 

has  been  obtained. 

Differentiating  the  numerators  of  Equation  7-73  and  letting  s  =  -  ft?  , 
gives  two  independent  equations: 

*  [f  +  zjt\c.-d  -  0  (7-81) 
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and 


(7-82) 


These  equations  are  not  linearly  dependent  and  an  apparent  difficulty  in  having 
five  equations  with  only  four  unknowns  is  resolved  only  when  it  is  recognised 
that  Equation  7-80  is  a  linear  combination  of  Equations  7-81  and  7-82.  Solving 
Equations  7-78,  7-79»  7-81  and  7-82  for  a,  b,  c,  and  d  (assuming  Xot  =  Xoi 
=  1)  and  substituting  the  results  into  Equation  7-72  gives: 


-  (0.829.5  S  t  3, 6099,) 

(S  Tjr? 

-[0- 20908 S  +  '03I32(>) 


(7-83) 


for  the  components  of  the  optimal  control  vector.  With  this  example,  the 
section  on  finding  the  optimal  control  law  in  a  direct  fashion  is  concluded.  It 
is  seen  that  the  basic  feature  which  makes  the  method  possible  is  the  fact  that 
if  s}(s)  is  to  be  analytic  in  the  left-half  plane,  it  must  contain  zeros  that 
cancel  the  left-half  plane  poles  of  <y(s)  .  It  is  possible  to  write  the  compo¬ 
nents  of  /j.  (s)  with  a  common  left-half  plane  pole  factor  because  the  poles 
of  u0  are  known  (primarily  from  the  root  square  locus). 

7.7  MODEL  FOLLOWING 

The  problem  of  including  models  in  a  system  to  approach  a  predefined 
set  of  closed-loop  dynamics  is  an  important  concept  in  linear  optimal  control. 
Without  a  model,  the  poles  of  the  closed-loop  system  will  tend  to  adjust  to  a 
Butterworth  pattern.  Thus,  while  the  Butterworth  pattern  is  usually  a  de¬ 
sirable  one,  there  may  be  cases  in  which  a  set  of  desired  closed-loop  poles 
are  located  in  the  s  plane  where  they  cannot  be  reached  on  the  optimal  root 
square  locus.  Of  course,  one  could  argue  that  if  you  already  know  where  you 
want  your  closed-loop  poles  to  be  located,  it  is  merely  a  matter  of  forcing  the 
desired  situation  by  solving  for  the  necessary  compensation.  There  is  a  ser¬ 
ious  flaw  in  an  argument  such  as  this  because  the  optimal  character  of  the  so¬ 
lution,  which  place b  a  constraint  on  the  control,  would  be  lost.  A  brute  force 
solution  for  the  desired  compensation  may  well  lead  to  control  deflections 
which  require  impulses.  On  the  other  hand,  the  optimal  control,  which  is  al¬ 
ways  described  by  a  proper  rational  function  of  s,  does  not  admit  impulses. 

While  one  may  usually  think  of  the  model-following  concept  as  being 
used  in  such  experiments  where  one  aircraft  is  required  to  reproduce  the 
dynamics  of  another  (perhaps  not  yet  built)  aircraft,  the  concept  can.  also  be 
used  to  include  specific  inputs  into  the  system.  That  is,  one  may  consider  the 
system  inputs  to  be  "models”.  (Another  method  for  including  inputs  has  al¬ 
ready  been  discussed,  namely,  the  a(t)  vector  of  Equation  7-1.)  It  will  be 
seen  that  the  advantage  of  including  inputs  in  the  form  of  a  prefilter  model  is 
that  one  may  continue  to  use  the  feedback  control  law,  u0~-fd%  ,  to  compen¬ 
sate  the  open-loop  system. 

To  begin,  it  is  assumed  that  the  model  is  included  in  the  physical 
system  as  a  prefilter  ahead  of  the  plant. 
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The  equation*  of  the  plant  are  taken  a* 


it#  ■  Xp  *  Gjt  U 

while  the  model  dynamics  are  defined  as 


(7-84) 


(7-85) 


The  state  equation  is  now  defined  as  a  combination  of  the  plant  and 
model  equations: 


(7-86) 


This  can  be  represented  as 


i>  *  *  <2u> 


When  both  the  plant  and  model  are  of  order  n,  and  it  is  desired  to  com¬ 
pare  all  the  state  variables  with  all  the  model  variables,  a  typical  choice  of 
the  H  matrix  would  be 


an  n  x  2n  matrix.  When  the  plant  and  model  are  of  une.qual  order,  dummy 
variables  can  be  added  to  the  particular  set  that  has  the  lowest  order.  That 
is,  one  of  the  matrices,  either  Fp  or  L,  will  pick  up  a  zero  row  and  a  zero 
column  for  each  dummy  variable  that  is  added.  This  defines  the  output  vector 
which  is  to  be  minimized  in  the  performance  index  as 


(7-87) 


The  Q  matrix  can  be  used  to  delete  those  error  terms  which  one  wishes 
excluded  from  the  performance  index.  One  may  also  specify  zero  terms  in  the 
H  matrix  that  will  immediately  eliminate  unwanted  terms  from  the  perform¬ 
ance  index. 

The  model  has  now  been  incorporated  into  the  standard  form  of  the 
regulator  problem  with  the  performance  index  defined  as 

r 

u'Bujat  (7-98) 

0 

with  the  optimal  control  law 

U,  -  -I 

As  T  -►  90  ,  the  feedback  gain  matrix  becomes  a  matrix  of  constants, 
and  the  results  of  Section  7.4  can  be  used  to  solve  for  the  optimal  control  law. 

Taking  the  Laplace  transform  of  Equation  7-87  and  substituting  in  the 
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transforms  of  Equations  7-84  and  7-85,  gives 
U  -  -\Ls-F^Y 

=  Wa  f  8 


(7-89) 


(7-90) 


as  the  equation  which  corresponds  to  Equation  7-38. 

The  Wiener -Hopf  equation,  Equation  7-39,  becomes 

(<v  [-  *  ■  [r»  -  <>]' 1 V -  e)% 

^  (7-91) 

Again  one  can  write 

♦  J  *  ^  (7-92) 

and  use  the  methods  of  the  previous  sections  to  solve  for  u0  . 

Suppose  now,  for  a  given  problem,  that  Equation  7-92  has  been  solved 
and  the  only  remaining  task  is  to  force  the  open-loop  control  to  obey  the  opti¬ 
mal  control  law.  That  is,  we  wish  to  find  a  specific  feedback  configuration 
for  the  system.  The  optimal  control  law 

Ut  =  ~k!*(s)  (7-93) 


can  be  used  for  this  purpose  if  one  is  careful  to  remember  that  we  are  working 
with  the  standard  form  of  the  regulator  problem.  This  means 


(*>' 


(7-94) 


which  says  that  both  the  model  variables  and  the  plant  variables  are  state 
variables.  Since  it  is  already  known  from  Equation  7-93  that  a  feedback  from 
each  state  variable  to  each  control  variable  is  required,  one  may  think  of  the 
gains  from  the  model  state  variables  to  the  control  variables  as  being  feed¬ 
forward  gains  and  the  gains  from  the  plant  variables  to  the  control  variables 
as  being  feedback  gains. 

Notice  that  the  direct  method  for  solving  a  matrix  Wiener-Hopf  equation 
tells  us  that  the  poles  of  a  model-following  system  arc 

1.  the  poles  of  the  model 

2.  the  poles  found  from  the  root  square  locus,  which  is 
found  from  the  expression 

j  Q  (7-95) 
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This  expression  is  independent  of  the  model.  The  im¬ 
plementation  of  this  portion  of  the  model -following 
system  therefore  depends  Bolely  on  the  feedback  gains. 

The  specific  feedback  configuration  for  the  system  can  be  found  by 
using  Equation  7-93  and  implementing  the  following  procedure: 

1.  The  components  of  y  (s)  are  founds  as  specific  functions 
of  s,  by  substituting  the  optimal  control  solution  into  the 
expression 

x(s)  -  [ is-Fydu  *  [js-f]  vfc)  (7-96) 

2.  One  now  substitutes  the  specific  components  otf-(s), 
found  from  step  1  above,  into  the  right-hand  side  of 
Equation  7-93. 

3.  The  closed  form  expression  for  U.d  is  then  substituted 
into  the  left-hand  side  of  Equation  7-93. 

4.  One  can  now  solve  for  the  unknown  feedback  gains  since 
the  two  sides  of  the  equation  must  be  equal.  The  set  of 
equations  which  results  will  always  be  a  linear  set. 

Once  again,  it  is  emphasized  that  equations  such  as  7-96  and  7-93 
involve  both  the  model  variables  and  the  plant  variables. 

Two  examples  will  serve  to  clarify  the  preceding  discussion.  In  the 
first  one,  we  wish  to  design  an  optimal  second-order  system  which  is  to  fol¬ 
low  a  step  input.  One  may  consider  the  step  input  to  be  represented  by  a 
model. 

Let  =  f ,  *0  (7-97) 

The  matrix  representation  is 

*  0vmt  (7-98) 

The  fixed  elements  (plant)  are  defined  by  Figure  24. 


a 


1 

s*  *  AS  *■  b 

Figure  24.  Open- Loop  Plant 
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In  Figure  24,  Vf  is  defined  as  the  output  variable.  This  system  can  be 
represented  by  the  equation 


r  vi 

r  o  r 

0 

1 1 

r 

. 

f 

] 

CM 

L :b  -  &  _ 

-*2. 

_  /  _ 

u 


(7-99) 


where 

Therefore 


=  *2 


0  1 
-b  -a 


The  Fp  matrix  is  2  x  2  while  the  L  matrix  is  1  x  1  (see  Equation  7-98). 
This  is  adjusted  by  adding  the  dummy  model  variable  to  Equation  7-98: 

-v  -|  r  0  O' 1  T  ~1 

t-mi  W 

(7-100) 

L 0  0  J  L^nt2~ 

Thus 


and 


y  •  [i  -i] 


Lo 

om 

'  1 

o  - 1  o' 

0 

1  0  -1 

*r»t 
* i 
*2 


(%rr>t  “  *i) 


(7-101) 


We  wish  to  exclude  ^W2-1t2  from  the  performance  index  since  our  ob¬ 
jective  is  to  minimize  the  difference  between  Xt  and  the  step  input.  This  is 
achieved  by  selecting 


Q  = 


o  o 


(7-102) 


R  -  r,  a  scalar,  since  there  is  only  one  control. 


We  may  now  proceed  directly  to  Equation  7-91  and  evaluate  the  various 
quantities  of  interest:  r  A 

L  /  .  s  J 

G'J-Is-fp]  Q  [^s-rJ  +  &  ~  [°  0  s*  -  <zs  +  ~B  I  Q  0\  *  *♦*»**" 


S  f  O’  f~l 
l-b  SJ 


f  r 


— *  r  ^ 


(s*  -45  *  bjfs*  +etS  +  b) 


(7-103) 
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Assuming  tpio)  =  0,  one  finds  (again  referring  to  Equation  7-91): 

p.s+a  -i>1 

-^L-^'p^r vo- -to  'J  v.,.;;; 

s  (s2-&$  +  i) 

Substituting  into  Equation  7-91  and  dividing  by  q,  one  obtains: 
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"s  O' 
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1  1 

1  W  _ 

L  1 

i 
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0  0_ 
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_r  _ 

<1  (s*-a.s*b)[st4-0'S+b) 


u  _ 
0  - 
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s(sz  -a,s  +b) 


-  % 


where 


or 


% 


± 

9 


r 

9 


(sa*<lS*6j(sa-A5*4>,) 

*here  2(B-fe)*a* 

8  -  /(>*<■  Ip 

Using  Equation  7-40, 


^  sfa4-  <&s ^ 


-  -  v-'  (V  j]+ 


and  comparing  7-103  with  7-21,  we  find 

sz*  45+b 


Y'(  = 

V. 


jty  (s*7*s7b) 

.1  sz-as+b 

jrft 


and 


J  - 


S(S*  “  45+  b) 


Equation  7-105  becomes  li\,  »  a 

\±)(S*  +  CLS+b) 

U°  =  Ws[s*+ocs7W 

To  find  a  specific  feedback  configuration,  let 

u0-  -&3*rk?4*t 


(7-104) 


(7-105) 


(7-106) 
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Applying  Equation  7-96* 

x(s)  -  +  [Xs-P]-# 


civ«« 


or 


w« 


*4  J 


0 

s  (sz  +  as  +  b) 

0 

0 

s* 

a  + 

0 

s» 

0 

sl  (s2  +  as  +  b) 


*»,  =  7 

*  w,  “  <2 


^  _  forj  / 

s*  TTsTE  3  ~sJsr7aTTbT 


„  _  sa  _  for] 

2  $z  +  (t5+b  ~  B 


f 


5*  /  B 


(7-107) 


Therefore, 

($/*.)  ( s  *  +  as  +  b) 


3  s(s2+a:s  +  '3) 


+  H. 


£  +  *(*/)  +  *  ^ _ 1_ 

s  +  *zLy#>i)  +  K3  3  sfsWs*# 

fVnl  1 


4  3  (s2+ccs-i-B 


(7-108) 


After  placing  the  right-hand  side  of  Equation  7-108  over  a  least  common 
denominator,  one  can  equate  coefficients  in  the  resultant  polynomials  and  solve 
for  the  K’s.  The  result  is 


K,  •- 


»A 


fW+Vr 


k?2  •  0 


ki3  »-b  +  /b*7  yr ' 


(7-109) 


^4  -  -  A  *  2[{bl+  %fr  *  -b) 


A  specific  system  configuration  is  shown  in  Figure  25. 
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Figure  25.  A  Specific  Feedback  Configuration 

A  more  elaborate  example  of  the  model-following  technique  is  given 
in  Section  9. 

We  close  with  a  simple  example  designed  to  show  the  basic  consequence 
of  the  generally  accepted  model-following  performance  index  and  to  further 
demonstrate  the  applicability  of  the  method  outlined  in  Section  6.  3.  Consider 
the  single  output  situation  depicted  in  Figure  26. 


-  transfer  function  of  the  model 
=  transfer  function  of  the  plant 

-  compensating  network 


Figure  26.  Single -Input,  Single -Output 
Model -Following  System 


The  performance  index  is 
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(7-110) 


Applying  the  results  of  Section  6,3,  one  finds 


/ 

- 

- 

— r 

“  -J  -J 

(7-111) 


as  the  optimal  control  vector.  The  optimal  transfer  function  of  Vfc  Cs)  is 


— (s)  -  ■ 

Kurfurm 

10  (s;" 

f 

J  +  <*>>*> 

(7-112) 


As  -►  oo  ,  we  see  that  the  optimal  transfer  function  tends  toward 

—  =  —  (7-113) 

10  £  L  WJ+ 

Suppose  R  =  l,(R(t)  is  a  delta  function)  and  ufm  has  all  left  half  plane  poles, 
then 


*2  *  "  *f 


(7-114) 


That  is,  whan  =0,  the  output  follows  the  input  exactly.  This  result  in 

no  way  depends  on  the  form  of  Ufa  and  . 


When  R  is  a  step. 


■y  =  M  -  «  [j  «'» 


evaluated  at 
the  poles  of  urw 


1,M 


poles  UK. 


m 


(7-115) 


That  is,  with  a  step  input  and  *! %  =0,  the  optimal  transfer  function 

is  not  exactly  equal  to  Ufa  but  does  have  the  same  poles  as  Ufa  . 

In  the  more  general  situation,  when  **/ f  t  0,  the  expression  for  the 
optimal  transfer  function  indicates  a  form 

(7-116) 


K 


(poles  of  root  square  locus)  (poles  of  model) 
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Thus  the  poles  of  the  model  are  always  present*  and  clearly  one  of  the  design 

Drnh1«m«  la  M  nljlr  •»  •*/*  thst  "VV ill  "llld  root  1CCUS  clCSfd 

far  enough  displaced  from  the  poles  of  the  model  so  that  the  dominant  roots 
are  those  of  the  model.  This  viewpoint  may  result  in  a  set  of  feedback  gains 
which  are  high  enough  to  cause  practical  difficulties  when  the  plant  is  an  air¬ 
craft.  This  point  will  be  discussed  in  the  more  elaborate  model-following 
example  of  Section  9.4.  It  is  also  apparent  that  the  effect  of  r/f  on  4t(») 
cannot  be  determined  from  the  root  square  locus  alone. 


The  previous  example  was  selected  to  highlight  what  appears  to  be  the 
basic  characteristic  of  the  pole  pattern  of  the  optimal  system  when  the  model¬ 
following  scheme  is  employed  -  that  is*  the  poles  of  the  model  are  always  pre 
sent  while  the  poles  of  the  plant  approach  a  Butterworth  configuration  as  they 
migrate  more  deeply  into  the  left  half  plane  (or  encounter  a  zero  of  the  open- 
loop  system).  In  addition*  the  zeros  of  the  system  are  not  defined  by  the  root 
square  locus  alone. 
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SECTION  8 

USE  OF  BODE  PLOTS  IN  LINEAR  OPTIMAL  DESIGN 


8. 1  INTRODUCTION 

Bode  plots  are  particularly  well  suited  for  the  task  of  determining  the 
closed-loop  poles  of  the  optimal  system  as  a  function  of  the  weighting  param¬ 
eters  of  the  performance  index.  The  use  of  Bode  plots  is  first  outlined  for 
the  single -input*  single-output  problem  and  then  extended  to  the  multivariable 
case.  A  relatively  complicated  design  problem,  involving  a  jet  fighter  in  a 
power  approach,  is  used  to  illustrate  the  application  of  the  concept. 

All  the  basic  tools  for  a  frequency  domain  design  procedure  are  avail¬ 
able  after  the  use  of  the  Bode  plots  is  outlined.  The  section  concludes  with  an 
outline  of  a  design  procedure  which  utilizes  these  tools  and  can  be  carried  out 
entirely  in  the  frequency  domain. 

8.2  SINGLE  VARIABLE  CASE 

The  purpose  of  the  multivariable  root  square  locus  is  to  determine  the 
closed-loop  poles  of  the  optimal  system  as  a  function  of  the  weighting  factors 
of  the  performance  index.  Bode  plots  are  also  particularly  well  suited  to  this 
task.  The  basic  reason  for  this  is  that  in  the  root  square  locus  only  the  pro¬ 
ducts  of  a  transfer  function  with  its  conjugate  are  involved  [e. g. ,  W(s)W(-s)J. 
Hence,  when  s  — *»  joo  the  phase  is  always  identically  equal  to  zero.  This 
means  that  the  closed-loop  roots  can  always  be  found  from  the  open-loop  trans¬ 
fer  function  using  only  the  zero  degree  line  on  a  Nichols  Chart,*  Hence  accur¬ 
ate  frequency  domain  representations  of  the  closed-loop  optimal  poles  are 
easily  found. 

While  accurate  mathematical  descriptions  of  the  closed-loop  poles 
are  possible  through  the  use  of  the  Nichols  Chart,  in  practice  one  finds  that 
the  usual  open-to-closed  loop  approximations  used  in  servo  work  become 
quite  accurate  when  applied  to  optimal  control.  Since  one  is  in  essence  work¬ 
ing  with  a  |W|Z  type  equation,  the  slopes  encountered  at  breakpoints  are  al¬ 
ways  on  the  order  of  40  db/decade  at  a  minimum.  Since  the  maximum  possible 
error  encountered  in  using  the  straight  line  approximation  is  6  db,  and  since 
we  are  working  with  steep  slopes,  the  error  in  the  break  frequencies  due  to 
the  use  of  the  straight  line  approximation  is  small. 

The  essence  of  the  Bode  plot  method  lies  in  recognizing  that  the 
expression 


|«+WV$W|  (8-1) 

can  always  be  placed  in  a  multi-unity  feedback  block  diagram  form.  It  is  only 
necessary  to  demonstrate  this  for  a  few  typical  cases  after  which  the  technique 
will  become  quite  transparent.  To  demonstrate,  we  consider  first  the  simplest 
of  cases.  For  the  single-input,  V-s^le* output  problem,  the  equation 


*  When  a  particular  value  of  q  or  r  is  permitted  to  take  on  a  negative  value, 
the  180e  line  on  the  Nichols  Chart  must  be  used. 
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reduces  to 


le+w«Qw I  *  o 


(8-2) 


/f 


•  0 


(8-3) 


Equation  8-3  can  be  investigated  in  two  ways  by  placing  it  in  unity  feed¬ 
back  form.  First,  consider  the  block  diagram  of  Figure  27. 


e 


O 


e(s) 


C(t) 


Figure  27.  First  Unity  Feedback  Form 


Using  block  diagram  algebra,  one  easily  finds 

C  ^urSb 

ft  ~  ~1  4-S.kT &  ^8" 

Thus  the  closed-loop  poles  of  the  system  shown  in  Figure  27  are  the 
same  as  the  roots  of  Equation  8-3. 


The  second  way  of  treating  Equation  8-3,  and  experience  shows  it  to 
be  the  preferable  way,  is  to  use  the  unity  feedback  form  shown  in  Figure  28. 


13 


'  I . T - 

*/r  u/& 


C 


Figure  28,  Second  Unity  Feedback  Form 
The  transfer  function  is  now 

C  m  f 

&  /  +■  —■  usur 

r 


(8-5) 


The  closed-loop  poles  of  the  system  shown  in  Figure  28  are  the  same 
as  the  roots  of  Equation  8-3.  The  advantage  of  this  second  approach  will  be¬ 
come  apparent  in  the  multi-input  situation. 
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When  usin,{  Bode  plot** 
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*  1 
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»  •  j*> 
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9  j* 
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(8-6) 


One  has  the  option  of  either  plotting  the  open-loop  transfer  function  with  double 
breaks  at  the  break  frequencies  or  plotting  the  open-loop  function  and  changing 
the  scale  of  the  ordinate* 


For  those  frequencies  for  which 


f 

9/r  urur 

»  t, 

(8-7) 

a 

n 

For  those  frequencies  for  which 

A  1.0 

(8-8) 

1 

Vr  ur  & 

-  « 

(8-9) 

C 

_m_  1 

(8-10) 

%/r  urur 

To  find  the  optimal  closed-loop  poles,  one  simply  plots  the  open-loop 
response  with  Q/r  =1.  The  poles  associated  with  other  values  of  are 

found  by  sliding  the  open-loop  plot  up  or  down  by  the  required  number  of  deci¬ 
bels.  The  breaks  read  from  the  Bode  plot  represent  both  the  left-half  and 
image  right-half  plane  break  frequencies.  The  left-half  plane  component  is, 
of  course,  the  only  one  of  interest.  The  approximations  giv^n  by  Equations 
8-8  and  8-10  have  proven  to  be  quite  accurate  for  the  majority  of  purposes. 

Of  course,  if  one  prefers,  the  ”0#  line”  on  a  Nichols  Chart  can  be  used  to  obtain 
more  exact  results.  For  convenience,  an  expanded  plot  of  this  ”0°  line”  is 
given  in  Figure  29. 

There  may  be,  depending  on  the  form  of  a  family  of  values  of 

**/$  for  which  either  Equation  8-8  holds  or  Equation  8-10  holds.  This  implies 
that  a  range  of  r/q  exists  for  which  the  closed-loop  roots  will  not  be  altered 
significantly.  When  this  situation  exists,  the  Bode  plot  approach  gives  the 
range  of  immediately.  The  use  of  this  property  will  be  more  clearly 

demonstrated  by  the  power  approach  example  of  Section  8.5  and  the  more  elab¬ 
orate  model-following  example  of  Section  9*  3. 

8.  3  EXTENSION  TO  MULTIVARIABLE  CASE 

This  procedure  is  readily  extended  to  the  multivariable  problem.  The 

,<"“lion  \V.W,QW\  -0 

in  a  typical  two  control  variable  and  two  output  variable  problem  might  reduce 
to 


126 


exact 
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Expanded  Plot  of  the  "0°  Lane"  on  a  Nichols  Chart 


!<■  ur„ur„  *-f  t  A  «r„ uit<  *  It  uruBrtt 

r<  ri  ri  rt 


‘77  *W]  * 0 

~t  “t 


where 


(8-11) 


*  %  •  ^  ^  %  *  r,  w»  *5/  *  %<•> '  «’»  " 


To  employ  the  Bode  plot  concept. 


set 


*s* 


17 


(8-12) 


As  shown  in  Appendix  II,  the  proper  power  of  the  open-loop  roots  will  always 
factor  out  of  the  numerator  of  expressions  like  Equation  8-12.  Hence  the 
order  of  the  denominator  of  the  rational  expression  Z  is  the  same  as  the  rest 
of  the  terms  in  Equation  8-11.  Equation  8-11  becomes 


I*  —  “it  <  ♦  ~  *i,  *i.  *  ~  A  *  0 

r<  rz  r,  r,  r/ 


(8-13) 


If  one  uses  the  first  approach  outlined  above  to  implement  the  unity 
feedback  form,  the  result  might  be  the  block  diagram  of  Figure  30.  (NOTE: 
Other  implementations  are  obviously  possible  by  properly  interchanging  the 
blocks. ) 


When  the  block  diagratn  of  Figure  30  is  analyzed  (one  must  close  the 
loop  five  times)  the  use  of  the  open-to-closed  loop  approximations  becomes 
invaluable  due  to  the  speed  with  which  they  can  be  implemented.  A  "serious" 
disadvantage  of  this  particular  block  diagram  implementation  is  that  the  open- 
loop  poles  enter  immediately  into  the  first  block  while  all  succeeding  blocks 
deal  only  with  ratios.  Thus,  for  example,  if  the  open-loop  poles  involve 
actuator  dynamics,  one  is  forced  to  include  them  in  the  first  stage  of  the  pro¬ 
cess  and  their  effect  is  likely  to  be  greatly  obscured  by  the  time  the  fifth  stage 
is  reached. 


The  more  desirable  implementation  is  given  in  Figure  31.  In  the  im¬ 
plementation  of  Figure  31,  only  the  zeros  of  the  various  transfer  functions 
need  be  considered  in  the  first  four  states.  The  open-loop  poles  of  the  sys¬ 
tem  do  not  enter  until  the  last  stage. 

A  design  problem  which  illustrates  the  use  of  Bode  plots  will  be  given 
in  Section  8.5  after  the  steps  in  a  design  procedure  which  can  be  carried  out 
entirely  In  the  frequency  domain  are  given  in  Section  8. 4. 
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8.  4  STEPS  IN  A  FREQUENCY  DOMAIN  DESIGN  PROCEDURE 


It  is  now  possible,  using  the  results  of  the  previous  sections,  to  post¬ 
ulate  a  trial-and-error  design  procedure  which  can  be  carried  out  entirely  in 
the  frequency  domain#  The  four  steps  are: 

1.  Using  the  multivariable  root  square  locus  (or  Bode  plots), 
find  the  closed-loop  poles  of  the  optimal  system  as  a  function 
of  the  weighting  factors  of  the  performance  index.  This  is  a 
trial  and  error  procedure  for  there  are  many  values  of  the  q's 
and  r's  which  may  give  the  same  closed-loop  poles. 

2.  After  deciding  on  a  particular  set  of  q's  and  r's  from  (1) 
above,  solve  for  the  components  of  the  optimal  control  law. 

There  are  two  ways  to  do  this: 

a.  spectral  factorization  (Section  7.  3),  or 

b.  the  direct  method  (Section  7.6). 

3.  Substitute  u0  back  into  the  expression 

*(s)~  [is-F]~f(2u  +  (is- P]'1 %(o) 

One  can  now  use  the  equation 
0Lo  *  -£*(•) 

and  a  partial  fraction  expansion  (or  more  direct  algebraic 
means  if  desired)  to  solve  for  the  unknown  feedback  gains 
(refer  to  the  example  in  Section  7.  7). 

4.  One  may  then  repeat  the  first  three  steps  using  a  different 
set  of  q's  and  r's  (which  give  the  same  closed-loop  poles) 
if  the  initial  trial  attempt  yields  a  system  for  which  the 
feedback  gains  are  too  high.  An  adjustment  in  the  design 
objective  is  called  for  if  one  exhausts  the  possible  values 

of  q  and  r  before  obtaining  a  desirable  set  of  feedback  gains. 

Of  the  four  steps,  it  is  the  first  which  requires  the  greatest  exercise  of  engi¬ 
neering  judgment.  This  is  primarily  due  to  the  large  range  over  which  the 
weighting  factors  may  vary  without  any  essential  change  in  the  closed-loop 
poles.  The  design  undertaken  in  Section  9.3  affords  an  excellent  illustration 
of  the  large  range  through  which  some  of  the  weighting  factors  of  the  per¬ 
formance  index  may  vary  without  any  appreciable  effect  on  the  closed-loop 
poles.  Thus  good  engineering  judgment  is  required  of  the  designer  if  he  is  to 
accurately  specify  the  possible  range  of  the  parameter  variation  without  the 
expenditure  of  an  excessive  amount  of  time. 

8.  5  DESIGN  PROBLEM  WITH  BODE  PLOTS 

To  illustrate  the  use  of  Bode  plots  in  a  more  complex  design  situation, 
we  consider  the  application  of  the  model-following  method  of  Section  7.  7  to 
the  problem  of  a  high  performance  jet  fighter  in  a  power  approach.  The  block 
diagram  of  Figure  32  will  be  used  for  this  investigation.  The  numerical  val¬ 
ues  for  the  various  time  constants,  etc.,  are  taken  from  Section  5.3. 
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ACTUATOR  AIRFRAME 


Figure  32.  Block  Diagram  of  Open- Loop  System 

In  Figure  32»  A  &  and  Ac  are  the  variables  to  be  controlled  while  A$j 
is  the  stick  deflection  which  (through  the  actuator)  causes  an  elevator  deflec¬ 
tion!  A  St,  .  The  only  control  variable  is  A££  •  We  seek  the  control  law  which 
will  define  the  optimal  A  £  •  The  various  feedback  gains,  which  will  force  A£fi 
to  behave  optimally,  have  not  been  shown  in  Figure  32.  Since  our  objective 
is  to  point  out  how  one  employs  the  Bode  plots  as  a  design  aid,  we  will  limit 
the  scope  of  the  problem  to  specifying  approximate  values  of  the  parameters 
which  will  more  than  likely  give  good  model-following  in  bothAtf  andA^. 

That  is,  the  variation  of  the  plant  poles  as  a  function  of  q  ,  gg  ,  r  and  A 
(the  actuator  root)  will  be  studied  but  the  zeros  of  the  optimal  control  law  will 
not  be  computed  nor  will  the  feedback  gains  be  specified. 

As  a  performance  index*  we  choose 

'**»]**  (8-14) 

Using  the  method  of  Section  7.4  (or  the  analysis  technique  of  Section 
6.3)  one  finds,  letting  Sc  -  S&0  ♦  $cf , 

[l*~r  (^uiS’i*-Jurbai)m/}(t)  (8-15) 

must  have  right-half  plane  poles. 

In  Equation  8-15 

M.ur  . 
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and  the  first  problem  facing  the  analyst  is  to  investigate  the  expression 

f 

T,  I  u  I  <8-171 

'*  —  UTfur.  <■—  «£  ^ 


Consider  the  block  diagram  of  Figure  33. 


Figure  33.  Unity  Feedback  Form  for  Design  Problem 
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Using  block  diagram  algebra,  one  readily  finds 
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Thus  two  successive  uses  of  the  open-  to  closed-loop  Bode  plot  technique  will 
yield  the  desired  result.  The  obvious  advantage  in  this  formulation  of  the  prob¬ 
lem  is  that  the  poles  of  the  system  cancel  out  in  the  first  step  and  one  can  leave 
the  task  of  investigating  the  effect  of  actuator  poles,  etc.,  until  the  second  stage 
of  the  procedure. 


Before  proceeding  with  the  analysis,  it  is  in  order  to  point  out  that  we 
are  involved  only  in  a  two-parameter  investigation  in  terms  of  9#/r  and  ^z/f  . 
Moreover,  the  optimal  procedure  assures  us  that  our  closed-loop  system  will 
be  stable  for  whatever  values  of  9j/i r  and  are  selected.  A  conventional 

trial  and  error  design  for  the  system  presents  a  situation  which  can  be  very 
complex  indeed.  For  example,  it  is  conceivable  that  in  executing  a  convention¬ 
al  design,  the  analyst  might  be  forced  to  manipulate  as  many  as  eight  param¬ 
eters  (since  each  transfer  function  is  of  the  fourth  order)  and  moreover,  he 
must  be  continually  checking  to  see  if  his  closed-loop  system  is  stable. 


We  now  investigate  the  first  stage  of  the  procedure. 
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This  plot  is  given  in  Figure  34  for  =2,4  (note:  4. 16 

therefore,  9*  /?,  x  4. 16  #  20  db). 


(8-19) 


(8-20) 
12  db, 


One  now  either  invokes  the  open-  to  closed-loop  approximation  or  uses 
the  0°  line  on  a  Nichols  chart  to  find  the  closed-loop  C/&,  (see  Figure  29). 
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This  closed-loop  frequency  response  is  also  shown  on  Figure  34.  One  easily 
deduces  the  analytic  form  of  C/^f  directly  from  the  plot.  Note  the  response 
brinies  from  o  tn  . ?  and  back  to  0.*  Fittine  z  straight  line  to  the  enact 

closed-loop  response  gives  a  new  break  frequency  of  (0  =  1.5.  Since  the 
actual  response  is  down  6  db  at  this  frequency,  and  since  only  a  break  of  -2 
is  involved,  we  conclude  .  ,  . .  _  . 


Of  course,  this  procedure  is  simple  to  carry  out  for  other  values  of 
9* /9i  ,  Figure  35  gives  the  exact  Bode  plots  for  G/1B,  as  a  function  of 

*  From  Figure  35,  one  arrives  at  the  following  approximations: 

i)  For  1±  =  Alii  i  500 

1,  <h/r 


Therefore 


Therefore 

a 

12 


1*± 


ILu/jUSt  +  JjL  ufa  Ufa 


<h/r 

Hifr 


±  .Of 


Hi  <Si 


1>3±  afaafa  +-?-UfaUfa 


1  *  4r  UJ*  *** 


We  now  move  on  to  the  second  stage  of  the  investigation.  In  light  of  the 
results  of  the  first  stage,  it  seems  reasonable  to  break  up  the  analysis  in  three 
parts: 

A.  AL  -£  .Of 
Hi 

That  is,  investigate  the  closed-loop  poles  as  a  function 
of  q  /V  ,  using  the  expression: 

/ 

*  0  represents  0  db/decade,  -2  represents  -40  db/decade,  etc. 
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B.  A  500 

That  is,  investigate  the  closed-loop  poles  as  a  function  of 
a.  Ir  •  using  the  expression: 

»r  •  — 

t 


C.  Investigate  a  typical  intermediate  situation,  such  as 
Therefore, 


Part  A 

When 


and 


where 


J_.  J 
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') _  (8-21) 

-  U7S  (5/.4<f  +1) 


Let  the  root  of  the  actuator,  along  with  /  ?  ,  be  a  parameter  of  the 
investigation.  Most  boost  actuators  used  in  aircraft  have  natural  frequencies 
between  .5  and  15  cps. 


We  can  now  investigate  the  behavior  of  C/R  by  using  straight  line  ap¬ 
proximations.  In  Figure  36,  the  open-loop  response  and  the  straight  line  ap¬ 
proximations  to  the  closed-loop,  for  different  values  of  9,/r  ,  have  been 

plotted  for  a  <*  2,  13,  and  50  rad/sec.  For  any  given  value  of  jv  the  ap¬ 
proximate  expression  for 


1 

can  be  read  by  inspection.  For  example,  when  q  /f*  B  10^  and  a  *  2  rad/sec 
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Note:  a  three -pole  Butterworth  configuration 


When  /♦*  <  .01, 
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Of  course,  our  interest  is  only  in  the  left-half  plane  poles  of  Equation  8-24. 


From  Figure  32,  it  can  be  seen  that  the  Aot  output  is  always 

When  the  optimal  control  is  found,  the  required  feedback  gains  can  be  com¬ 
puted.  Closing  the  loops  in  Figure  32  using  the  values  of  the  optimal  gains 
will  force  a  d«  output  which  is  exactly 

(8-25) 


where 


From  Equation  8-16  the  form  of 

o  6r 


can  be  shown  to  be 


A  *  roots  of  root  square  locus 
r  *  poles  of  the  model 
V  a  open-loop  poles 

{(«)  is  a  polynomial  which  results  from  the  partial 
fraction  expansion  of  the  bracketed  term  in 
Equation  8-16. 


(8-26) 


Thus  the  closed-loop  «t  output  is 


S  I  ■  ■  -■  e*  w - 

6  r 


(8-27) 
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for  9t /*“  ~  a  =  2  rad/sec  and  9f(s)  =■  -2.4  £  (s)  .  Experience  indicates 
that  %f(9)  will  not  contain  the  factor  (s/.49  *■  1  )  .  Hence  the  optimalddf  re¬ 
sponse  will  be  dominated  by  the  pole  at  s  -  -.49. 


On  the  other  hand,  the  optimal  49  response  is 

and  will  have  closed-loop  dynamics  for  -  1®’  and  a  =  2  rad/sec  propor¬ 

tional  to: 

.  ( 

"  SSgQaMiM  W^\ J  (•-»> 


The  model  poles  will  dominate  the  response,  if  we  consider  a  separation  of 
slightly  greater  than  one  octave  between  the  model  and  plant  poles  as  being 
sufficient. 


Thus  we  see  that  our  chances  of  obtaining  good  model  following  in  A9 
are  good  for  the  case  where  9*  »  ^  »  but  the  Ltc  response  will  in  all  prob¬ 
ability  be  very  poor.  The  value  of  the  actuator  root  does  not  materially  affect 
this  result  since  the  dominant  root  in  the4<r  response  is  at  such  a  low  break 
frequency  (  s  a  -,  49).  We  now  proceed  to  Part  B. 

Part  B 

The  search  must  be  continued  if  our  interest  lies  in  obtaining  a  good 
ae  response  as  well  as  a  good  &£  response.  Consider  now  the  case  where 
Hz/9f  *  500.  In  this  event 

1  1 
- - - - - -  a  - - - 

t  +  * +?£&*&*  (8-29) 

Refer  to  Figure  37  for  the  Bode  plot  associated  with  this  situation.  The  par¬ 
ameters  for  this  investigation  are  and  a,  the  actuator  root.  From  Fig¬ 

ure  37,  it  is  apparent  that  the  open-loop  zero  at  s  =  -19,4  will  become  the 
dominant  pole  introduced  by  the  plant  tor  the  following  approximate  values  of 

«.  /*■  •• 

%Jf  *  1 09  for  a  -  2  (extrapolated  from  plot) 
qt/r  *  10^  for  a  =  13 
4,/r  4  105  for  a  =  50 


Since  the  higher  values  of  9*/f*  imply  higher  feedback  gains,  it  is  obvious 
that  a  high  penalty  will  be  paid  if  a  poor  actuator  i*  incorporated  into  the  sys¬ 
tem.  If  it  is  assumed  that  a  *  50  and  4*/**  *  10®,  then  the  design  objective 

of  good  model  following  can  be  achieved  in  both  A«  and  46  .  To  illustrate, 
assume  fy/  r*  *10°  and  a  *  50, 
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Figure  37*  Closed- Loop  Roots  with  as  a  Parameter 
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If  a  separation  between  plant  and  model  poles  of  approximately  four  octaves  is 
acceptable*  it  is  apparent  that  good  model  following  can  probably  be  achieved 
in  bothAganddd  .  However,  to  verify  this,  one  must  find  not  only  the  poles 
of  »  but  the  zeros  as  well.  This  normally  would  be  the  next  step  in  the 
design  procedure,  after  which  the  feedback  gains  would  be  computed  if  accept¬ 
able  AG  and  ddC  responses  were  actually  found. 

At  any  rate,  we  have  so  far  discovered  that  the  situation  in  which 
does  not  appear  as  promising  as  the  case  where  4,  «  .  Fur¬ 

thermore,  we  will  probably  be  interested  in  investigating  more  thoroughly  the 
case  where  a  is  on  the  order  of  50  rad/sec  and  /f*  13  on  the  order  of  10®, 

So  far,  the  two  extreme  cases  where  »  <?2  and  have  been 

investigated.  For  »  V2  we  found  the  zero  of  the  ur$  transfer  function  at 
s  *  -.495  became  the  dominant  pole  of  the  optimal  control  and  more  than  likely 
would  seriously  degrade  the  model-following  capability  inA«  .  For  9/  >:>  i 
the  zero  at  s  =  -19.4  of  the  transfer  function  has  the  potential  for  becom¬ 
ing  the  dominant  pole  of  the  optimal  control  and  it  is  felt  that  good  model  fol¬ 
lowing  in  bothAaandA^  can  more  than  likely  be  achieved.  ?•  ir  the  intermediate 
case  where  4t  *  ,  one  might  suspect  that  the  dominant  root  will  lie  between 

s  *  -19. 4  and  s  =  -.  495.  This  indeed  turns  out  to  be  the  case  and  we  will  be 
forced  to  conclude  that  the  situation  of  part  B  remains  the  one  on  which  further 
effort  should  be  expended.  To  show  that  the  case  where  *  <ft  is  of  not  too 
great  interest,  we  proceed  to  the  analysis  of  part  C. 

Part  C 

It  remains  to  investigate  the  intermediate  situation  for  which  ^  a  qt .  In  this 
case,  the  block  diagram  of  Figure  33  reduces  to  the  following  block  diagram. 
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An  approximate  expression  for  0>/l3t  can  be  found  from  Figure  35,  but  it  is 
a  simple  matter  to  evaluate  it  analytically  since  only  first-order  breaks  are 
involved.  The  analytical  expression  for  0/£,  is  found  to  be 


-T>  /  *  \  /  .c  \ 

to  -a  a\ 

ft} £  is  then  of  the  form 

JL=  ,14  u/’ur 

E 

(8-33) 

I’m*') 

(8-34) 

The  Bode  plot  of  Figure  38  summarizes  this  situation.  It  is  seen  that 
s  =  -1.12  will  always  be  the  dominant  root  of  the  optimal  control  and  will  not 
be  cancelled  out  of  either  thedtf  or  d£  response.  This  situation  defeats  the 
model-following  objective  entirely.  Moreover,  it  can  be  seen  that  other 
intermediate  values  of  and  will  merely  position  the  dominant  root 
between  s  =  -.49  and  s  =  -19.4.  This  verifies  the  assertion  made  at  the 
close  of  the  analysis  of  Part  B. 

At  this  point,  one  should  return  to  Part  B,  solve  for  the  zeros  of  the 
optimal  control  law  and  find  the  feedback  gains.  If  these  feedback  gains  are 
too  high  to  be  used  in  a  practical  situation,  one  may  either  relax  the  separa¬ 
tion  requirements  between  the  model  poles  and  plant  poles  or  incorporate 
another  control  (e.g.,  throttle)  into  the  design.  We  will  pursue  these  con¬ 
siderations  no  further  since  our  objective  was  merely  to  demonstrate  how 
Bode  plots  might  be  used  as  a  design  aid. 

In  summary,  this  brief  analysis  has  shown  that  the  situation  in  which 

9*  >> 

*  io5 

<L  *  50  rad/sec 

is  one  for  which  good  model  following  in  both  &  and  9  might  be  expected. 
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igure  38.  Closed- Loop  Roots  for  qf  st  ^  as  a  Function  of 


SECTION  9 

A  MULTIVARIABLE  EXAMPLE 


This  section  presents  a  multivariable  analysis  of  a  linear  optimal  con¬ 
trol  system  using  the  model  techniques  described  previously.  The  model-in- 
the -performance -index  technique  using  two  control  inputs  is  analyzed  using  a 
root  square  lotus.  The  equivalent  Bode  piot  method  is  used  in  conjunction  with 
the  model-following  idea. 

The  object  to  be  controlled  is  a  small  jet  transport  and  the  model  is  the 
proposed  supersonic  transport  aircraft.  The  objective  of  the  analysis  is  to 
choose  a  performance  index  yielding  an  optimal  control  law  that,  if  synthesized, 
will  force  the  small  jet  to  respond  dynamically  like  the  proposed  SST  within  the 
control  capability  of  the  jet  transport.  The  purpose  of  this  section  is  to  dem¬ 
onstrate  multivariable  analysis  techniques,  and  not  necessarily  to  produce  the 
best  design.  For  this  reason,  only  one  set  of  aerodynamic  derivatives  has 
been  chosen,  and  therefore  only  one  flight  condition  is  represented. 

9.  1  EQUATIONS  OF  MOTION 

The  equations  of  longitudinal  motion  for  the  SST  and  for  the  small  jet 
transport  are  assumed  to  be  given  by  the  following:  ' 

+  *  VT  Da  A«  +  g  A  6  =  -  Vr  Dgr  A  ST 

1 

*'tfeASe  (9-U 

-My  AV-Mj  Ai-MaA*  *A9 -M.A6  -  Mfe  ASg 


In  first-order  form,  these  equations  become 
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These  equations  can  be  used  to  describe  both  the  supersonic  transport 
which  “/ill  h*  ae  a  mnriel.  anH  tha  small  jet.  which  will  be  used  as  the 

plant  to  be  controlled.  Both  of  these  mathematical  model  representations  are 
describable  by  Equation  9-1.  The  following  table  lists  the  aerodynamic  deriv¬ 
atives  used  for  a  numerical  example  of  the  use  of  models  in  linear  optimal 
control. 


TABLE  3 

AERODYNAMIC  DERIVATIVES 


Acr  (.rod) 

Vet 

tv 

fe 

SST 

257 

.  138 

-.  1190 

-.0677 

.0263 

-.257 

-. 0173 

JET 

257 

.209 

-.0679 

-.0329 

.0296 

-.253 

-. 0262 

Mv 

SST 

-.842 

-.  129 

-.697 

-.  514 

0 

-.771 

-.965 

JET 

-.667 

-.0326 

-1. 75 

-.215 

.000366 

-.536 

-2.66 

Both  of  the  aircraft  are  assumed  to  be  in  a  powered  approach  flight 
condition  at  sea  level.  It  is  assumed  that  the  SST  is  in  a  light-weight  config 
uration  and  the  jet  in  a  heavy-weight  configuration. 

Using  the  derivatives  of  Table  3  above,  the  first-order  equations  of 
motion  are  obtained  by  substitution  in  Equation  9-2. 


The  plant  (the  jet  aircraft)  becomes: 
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and  the  model  (tne 

SST)  becomes: 

.  **  -in 

~~-Tz65 

.00000442 

.1 0005067 

-.2338 

\Mm 

.0048 

-.898" 

AOm 

1.0 
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0 

J. 
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r«r„' 
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-3Z.2 

-.0263 

30.38 
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17.4 
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The  transfer  functions  of  and  b&  for  the  plant  have  been  obtained) 

a  r\A  at**  rt  i  tra  n  m«r 

Plant 


9.2  MODEL  IN  THE  PERFORMANCE  INDEX 

The  problem  of  including  models  in  a  system  to  obtain  a  predefined  set 
of  closed-loop  dynamics  is  an  important  concept  in  linear  optimal  control. 
Without  a  model»  the  closed-loop  optimal  system  will  adjust  towards  a  Butter - 
worth  distribution  of  the  excess  closed-loop  poles  over  zeros  of  the  system. 

If  there  are  no  zeros*  all  the  closed-loop  frequencies  will  increase  without 
bound  as  the  elements  of  the  Q  matrix  are  made  large  with  respect  to  the  ele¬ 
ments  of  the  R  matrix. 

The  optimal)  minimum  error  square  characteristic  is  desirable*  but 
more  is  needed*  and  a  model  supplies  this  need.  A  model  defines  the  points 
at  which  the  closed-loop  poles  terminate*  yet  does  not  destroy  the  optimal 
characteristics  of  the  solution.  This  means  that  a  system  can  theoretically 
be  designed  to  have*  within  limits*  any  closed-loop  regulator  dynamics  defin¬ 
able  by  a  model.  As  the  elements  on  the  Q  matrix  become  large  with  respect 
to  the  elements  of  the  R  matrix*  the  closed-loop  regulator  poles  do  not  increase 
without  bound*  they  can  be  made  to  terminate  at  the  model  poles.  The  result 
is  a  closed-loop  system  approaching  the  system  defined  by  the  model. 

The  supersonic  transport  will  be  used  as  the  model  for  this  multivariable 
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example  and  the  jet  aircraft  is  to  be  used  as  the  plant  to  be  controlled.  The 
small  jet  is  assumed  to  h»v«  twn  control  inputs;  elevator  deflection  changes 
and  variations  of  thrust  about  the  nominal.  As  demonstrated  in  Section  3,  the 
model  and  the  plant  cannot  be  matched  exactly  because  there  are  four  state 
variables  and  only  two  available  controllers.  Therefore!  for  the  purposes  of 
this  examplet  it  was  decided  to  match  the  two  short  period  poles  of  the  small 
jet  to  those  of  the  SST. 

As  discussed  in  Section  3,  the  model  is  defined: 

f  *  Ly  (9-5) 

and  the  plant  is  % 

y«//*  (9-6) 

The  performance  index  is 

00 

2V«  J^-LyfQlij-Ltjl  +  UTSu^dt  (9- 7) 

0 

From  Equation  3-80,  it  was  found  that  the  expression  for  the  root  square  locusi 
and  therefore  the  expression  for  the  closed-loop  poles  of  the  optimal  system, 
is  given  by: 

* 0  (9-8) 

In  order  to  match  the  short  period  poles  of  the  small  jet  to  those  of 
the  SST,  it  will  be  necessary  to  express  this  requirement  exactly  in  the  per¬ 
formance  index.  The  way  to  accomplish  this  is  to  transform  the  L  and  the  F 
matrices  into  a  modal  matrix  form.  In  other  words,  the  model  matrix  becomes 

L,  0  0 

0  Lt  0 

L  ‘  0  0  L, 

__0  0  0 

where  Lf  ,  Lt  »  L*  and  L+  are  the  eigenvalues  of  the  model  matrix.  In  a  sim¬ 
ilar  manner,  it  is  necessary  to  transform  the  equations  of  motion  of  the  plant 
such  that  the  transformed  system  matrix  is  a  modal  matrix  whose  diagonal 
entries  are  the  open-loop  roots  of  the  plant.  In  order  to  obtain  this  modal  ma¬ 
trix,  it  is  necessary  to  find  a  transformation  T  such  that  an  orthogonal  state 
vector,  $  ,  is  obtained, 


0 

0 

0 


*  -A., 


(9-9) 


X  -  Tv 


(9-10) 
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become 


Substituting  into  the  plant  equations  of  motion  (9-6),  the  new  equations 


2 

a  -A-p.  -2  * 


where  -AF  is  the  modal  matrix 
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(9-12) 


With  the  use  of  these  newly  defined  quantities,  a  performance  index: 
can  be  formulated  that  will  exactly  express  the  desire  to  match  closed-loop 
poles  of  the  plant  to  the  eigenvalues  of  the  model*  The  performance  index 
becomes 


oa 

(9*13) 

0 

With  this  formulation  of  the  problem,  the  output  matrix  P  can  be  cho¬ 
sen  to  select  only  those  roots  of  the  plant  that  are  to  be  matched  to  the  eigen¬ 
values  of  the  model. 


If  the  model  modal  matrix  is  arranged  such  that  the  eigenvalues  L9 
andL^  are  the  short  period  poles  of  the  model  and  %g  and  Xg  are  the  open- 
loop  short  period  poles  of  the  plant,  the  output  matrix  &  may  be  chosen: 


U  * 


0 

0 

0 


0 

0 

0 


0  0 
0  o 

i  0 


(9-14) 


LP  o  o  I, 


With  this  formulation  of  N  ,  the  performance  index  will  contain  only 
the  short  period  dynamics  of  the  plant  and  the  model  to  the  exclusion  of  the 
phugold  dynamics. 


In  terms  of  the  transformed  quantities,  the  root  square  locus  can  be 
expressed  as  follows: 


I ♦  ■  0  (9-15) 
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Every  entry  of  Equation  9-15  is  known  with  the  exception  of  Q  and  R. 
Because  the  root  square  locus  is  a  function  of  the  ratio  of  the  elements  of  Q 
and  R.  th«  R  m*y  be  chose r.  to  be  the  unit  matrix 


(9-16) 


The  matrix  Q  is  chosen  to  be  a  diagonal  matrix 

^000 

o  qt  o  o 

Q  m  o  o  q  o 

0  0  0  ^ 


(9-17) 


When  substituting  the  constituent  matrices  into  the  expression  for  the 
root  square  locus  in  order  to  perform  a  computation,  it  has  been  found  con¬ 
venient  to  start  with  the  Q  matrix,  alternately  pre-multiplying  and  post- 
multiplying  until  the  entire  product  $'[-Is~Al,]mtft,[‘lt-AjQ[la.Atl]P[lt-Ary,2 
is  obtained. 

First,  compute  [-l$-Al]Q  [is-Ai,] 
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o 
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0  0 

0  0 

^(-**♦4,^  0 

o  9,  { 


and  ft'  (*I$-Al)Q  (ls-Au)  ft 
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0 
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becomes 
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(9-19) 


A  review  of  the  computation  at  this  point  already  reveals  a  few  inter¬ 
esting  facts.  The  elements  qt(-s*+  4fx)  and  (-9**1,  *)  are  not  included  in 

-Au ] Q  [Is-A^jft  and  will  therefore  not  appear  at  all  in  the  expression 
for  the  root  square  locus.  These  terms  could  have  been  included  if  ft  had 
been  a  unit  matrix. 

If  the  above  computation  procedure  is  continued,  the  total  root  square 
locus  expression  will  be  obtained: 
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(9-20) 


2)5  -(-5*. A, *fcn*+%*)(-8K %*)(- s V l4 V 
where  AjJtj  *  (-s,*Jlv4^-s**A5M",,**e1V 
AfA«  ■  (-»**  1%  )('**+ ^s*) 


This  root  square  locus  expression  can  be  simplified  to  the  following 


* 


(9-21) 

The  last  term  of  this  root  square  locus  expression  is  the  most  Impor¬ 
tant.  It  defines  the  end  points  of  the  locus.  These  end  points  are  (-**•  Lt%) 
and  (-3 *-£4*) ,  the  two  chosen  short  period  roots  of  the  model.  As  the  product 
9»  ?« ■*■ 00 »  the  short  period  roots  of  the  small  jet  will  become  equal  to  the  model 
short  period.  Notice  that  the  jet  phugoid  roots  do  not  appear  in  the  root  square 
locus  expression  at  all.  The  two  eigenvalues  A.  and  %g  have  been  made  unob¬ 
servable  by  the  collineatory  transformation  on  the  original  state  variables*  and 
they  are  completely  excluded  from  the  performance  index.  The  transformed 
state  variables  associated  with  A,  and  tt  do  not  appear  in  the  feedback  con¬ 
trol  law. 


0  U — 


/ft,  iH-hth.H-t’-L.'lh'-L,') 


Numerical  Example 


The  small  jet  and  the  SST  equations  of  motion  of  Section  9. 1  will  be 
used  to  show  a  numerical  example  of  the  modal  technique.  To  simplify  the 
problem  and  still  show  a  non -trivial  example*  it  was  decided  to  delete  the 
small  terms  end  f4a  of  the  original  F  matrix  of  Equation  9-3. 

These  terms  contribute  primarily  to  the  phugoid  motions  of  the  aircraft*  such 
that  the  deletion  will  result  in  a  phugoid  pole  at  the  origin  and  a  negative  real 
phugoid  root.  The  purpose  of  this  example  will  be  to  demonstrate  the  use 
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of  two  controllers  to  exactly  control  two  roots  without  affecting  the  remaining 
two  roots.  The  short  period  roots  are  the  ones  that  will  be  changed,  so  the 
nhnenid  root  locations  will  have  little  effect  on  the  problem  result. 


form 


After  deleting  S,i  ,  ,  f4%  a“<*  Aj  from  F*  the  matrix  i#  ot  the 


(9-22) 


and  the  SST  model  matrix,  with  the  same  approximations,  becomes 
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A 34 
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The  matrix  [is  -  F]  becomes 


Is-  F  * 
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0 

-f 


0 
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4a 
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0 
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f4 


-■P, 
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(9-24) 


The  open-loop  characteristic  equation  of  the  small  Jet  is  given  by 

|ls-r|  c  4*]  -  0  (9-25) 


The  open-loop  roots  of  the  small  jet  are  obtained  from  the  solutions  of  Equa¬ 
tion  9-25.  These  roots  are: 


A,  -  O 

4 

*3  »  *4  “ 

2 

*4± 

e  m-f3$  ]  Roots  associated  with  the  phugoid 
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Correspondingly!  the  open-loop  poles  of  the  SST  are: 


^  •  u 


Lt  *  J9s  /  phugoid 


Ls,  L4  -  JhilJhl  ±  J.  J (itf  +d,4  -4  ^  i44  1  J  Short  period 

2  2  »  J 

Before  the  actual  root  square  locus  expression  can  be  constructed!  the 
collineatory  transformation  T  must  be  obtained  and  the  equations  of  motion  of 
the  small  jet  must  be  transformed  into  the  set 


i  »  r'rr#  ♦  r^Qa 

* Af  %  *  Gu 


9-ht* 


The  transformation  T  is  an  n  x  n  matrix  whose  columns  T}  satisfy  the  equa¬ 
tions  (Reference  13). 


[**»  -F]  M  -  o 


(9-26) 


The  column  matrix  is  called  a  modal  column.  It  is  a  column  of  the 
T  matrix  associated  with  the  eigenvalue  Xi  of  the  modal  matrix  .  The 
determinant  llXj-ff  =  0  by  definition!  so  Equation  9-26  has  an  infinite  number 
of  solutions!  including  the  trivial  solution  Ti  *  0.  Any  non-trivial  solution  of 
Equation  9-26  may  be  chosen  for  the  l**1  column  of  the  T  matrix.  To  illustrate! 
consider  the  root  Xf  *  0,  Equation  9-26  becomes 


■ 0 


-t„  -  o 


*!»*»-*»  W«*fl 


(9-27) 
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Equations  9-27  have  a  non -trivial  solution 


-  _  n 

*tf  ~  T  53 


*3t  ~  ~^3i 

tit  *  o 


(9-28) 


Proceeding  in  a  similar  manner  with  the  other  three  eigenvalues  of 
|ls  •  F|  ,  the  required  orthogonal  transformation  T  can  be 

n. '« ‘n  <n  i  o  o  -i  i 


tit 


tM  tSl 


-4  < 


[~  /9  29) 

.(VWVWj  Lw'Uv'wJ 


*4 1  Ut  *4J  *4i 


(&4~ 


It  has  been  proven,  that  the  transformation  T  always  exists  for  distinct 
,  If  the  roots  are  repeated  roots*  a  distinct  improbability  among  aircraft* 
the  transformation  may  or  may  not  exist. 

In  order  to  complete  the  transformation  of  the  original  equations  of  mo¬ 
tion  of  the  plant  to  the  orthogonal  form,  the  matrix  2  »  T~1  G  must  be  obtained. 
The  inverse  of  T  is 


-t41 

T«*j 

t 

-Tn 

Tn 

'T„ 

T4Z 

trl 

*  TrT 

T,s 

-Tn 

T„ 

*7*45 

Tt4 

-T,i 

T44 

(9-30) 


where  Ty  are  the  minors  of  I  T  |  . 

For  this  particular  problem,  the  first  two  rows  of  £  do  not  enter  into 
the  root  square  locus  expression  of  Equation  9-21.  It  will  therefore  not  be 
necessary  to  compute  the  first  two  rows  of  ,  Since  the  second  row  of  G 
is  null,  the  minors  7“**  and  7r«  will  not  appear  in  T~*  Q»  .  Therefore,  it 
will  be  necessary  to  calculate  only  Tf3  ,  T„  ,  T4t  ,  Tf4  ,  T34  and  T44  . 

It  is  found  that 
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iri  -  ft,f  **<s) 

+4 

The  required  elements  of  <*  are  then  obtained  from 

i —  — i  I  9>« 

|  -is.  0  -fll  0  0 

*99 


f,t  (*44  "  *4$) 


Jj*-  o  -/ 


i _  •*  _ i  y 

where  &  t,t  indicates  that  the  first  and  second  rows  of  Q  are  omitted. 
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'•*  (*44*Ut) 
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(9-32) 


Using  the  numerical  values  of  f^i  from  Equations  9-3  and  9-4,  it  is 
found  that  the  open-loop  short  period  penes  of  the  small  jet  and  the  SST  are 


-  -.7155  +  jl. 264 
%4  =  -.7155  -  jl. 264 


L9  =  -1.072  +  j.  459 
L4  *  -1.072  -  j.  459 


Substituting  these  values  of  %3  and  into  the  expression  for  the 
T  transformation  yields 
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-.0294  0 
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-.03 £5  7]  1164 


- .  71  £5  -  j  1.2*4 

-13.MB4-J4t.7fS 
liter  *J  13374 

1 

-.03S3T-  JIH4 
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The  elements  of  T  are  complex,  and  the  elements  g will  also  be 
complex.  Substituting  in  9-32  yields 

=  -.  00075  +  j.  00433 


=  +.00075  +  j.  00433 
~  +1.325  +  j.  0578 


(9-34) 


g4i  =  -1.325  +  j.  0578 

However,  when  the  elements  of  (fy  are  substituted  into  the  root  square  locus 
expression,  the  result  does  not  contain  complex  quantities. 


It  was  shown  that  the  product  q9  is  an  important  parameter  of  the 
root  square  locus  expression.  This  product  determines  the  rate  at  which  the 
poles  of  the  plant  approach  those  of  the  model  in  the  root  square  locus  expres¬ 
sion.  Because  the  product  q9  is  important,  it  will  be  sufficient  to  let 
?s  s  <h  8  $  .  With  this  simplification,  the  expression  for  the  root  square 

locus  becomes: 


[(?„**  VJl'-’1*  *.’)>  «,,*>  V>] 


7 

.  <?, J,,- 


(9-35) 


After  substituting  for  and  %g  ,  Equation  9-35  can  be  written: 


0  -  f-  q 


3.504(s*+.223s**.S4o) 
9**  Z.  1736**+  4.4STS 


(.0001 32) ( s*-  1.37069*+ 1.66.94) 
S4*  2.1736  9*  +  4.4SS 


The  root  square  locus  plot  of  Equation  9-36  can  be  easily  obtained  using 
one  of  the  many  digital  programs  designed  for  the  purpose.  The  important 
observation  is  that  the  two  plant  poles  do  take  on  the  value  of  the  model  roots 
as  q  becomes  very  large.  It  can  be  argued  that  the  actual  locus  itself  is  rela¬ 
tively  unimportant;  optimal  control  has  been  used  as  a  tool  to  attain  a  design 
goal  that  can  be  obtained  by  conventional  techniques.  This  is  true,  but  the 
design  technique  described  above  has  several  advantages  over  a  conventional 
technique: 

1.  As  a  parameter  is  varied  to  locate  one  set  of  roots  at  a  new 
location,  there  is  guaranteed  to  be  no  intermediate  parameter 
value  that  would  result  in  instability. 

2.  The  two  open-loop  poles  excluded  from  the  root  square  locus 
expression  are  not  changed  at  all  from  their  open-loop  values. 

3.  The  method  is  unique  and  direct. 

It  is  instructive  to  construct  the  locus  in  order  to  show  how  the  plant 
poles  are  altered  to  eventually  become  identical  to  those  of  the  model.  The 
locus  is  shown  in  Figure  39  as  a  function  of  q.  The  figure  shows  that  the 
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closed-loop  poles  wander  somewhat  before  finally  terminating  at  the  roots  of 
the  model. 


Figure  39.  Realizable  Part  of  the  Model-in-the- 
Performance -Index  Root  Square  Locus 


The  reason  for  this  can  be  determined  from  an  examination  of  Equa¬ 
tion  9-36.  The  root  square  locus  expression  can  be  rewritten  in  the  form 


r,  _^£  *1^1 

Dff  I  *  NfRf 


-  O 


(9-37) 


For  small  values  of  q,  ,  the  locus  is  described  very  closely 

by 


VU 


-  0 


(9-38) 
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For  large  values  of  q,  when  »  !6,  ,  the  locus  is  approximated  by 


r  * 


VT5 


n 


(9-39; 


If  it  is  assumed  that  the  low  q  approximation  holds  for  q  smaller  than 
that  obtained  from 

(J  .S04)t.S*0)  (.OOOt3Z)(t.B63*)  _ 

- *4S - 10  *  -1 - - 1  <9-40) 

or 

0A2S  s  fO  *  .0000652  q 

then  the  segment  a-b  of  the  locus  shown  in  Figure  39  is  approximated  closely 
by  Equation  9-38.  If  it  is  assumed  that  the  high  q  approximation  is  valid  for 
values  of  q  greater  than  obtained  from 


10  *  .  4-ZS  »  .  00005S2  q 


(9-41) 


then  the  high  q  approximation  is  valid  only  on  that  part  of  the  locus  very  close 
to  the  model  roots.  Because  the  high  q  approximation  holds  only  very  near 
the  model  roots,  the  intermediate  part  of  the  locus,  b-c,  can  be  approximated 


very  closely  by  the  expression 

u,  ±  -o 

V,  N,  N, 


(9-42) 


The  two  segment  approximations  to  the  root  square  locus,  namely 
Equations  9-38  and  9-42  serve  to  demonstrate  that  a  construction  using  a  root 
locus  plot  is  possible  and  not  difficult  even  though  a  term  q2  appears  in  the 
original  expression  for  the  root  square  locus. 


It  is  clear  that  the  procedure  of  first  transforming  the  system  equa¬ 
tions  of  motion  into  a  diagonal  form,  before  analyzing  the  optimal  system, 
yields  a  direct  method  of  matching  part  of  a  dynamic  system  to  the  model  dy¬ 
namics,  without  affecting  the  remaining  dynamic  characteristics.  Two  con¬ 
trollers  were  required  to  accomplish  this  match,  one  for  each  pole  of  the  dy¬ 
namic  system  to  be  altered.  It  is  well  known,  however,  that  one  controller 
can  normally  be  used  to  alter  short  period  aircraft  dynamics,  but  as  it  turns 
out,  not  without  affecting  the  phugoid  dynamics  of  the  airframe.  This  tech¬ 
nique,  then,  has  the  advantage  of  directly  selecting  the  dynamics  to  be  altered, 
and  then  yielding  a  feedback  configuration  that  alters  the  selected  dynamics 
in  a  reasonable,  preselected  fashion. 

9.3  A  COMPLEX  MODEL- FOLLOWING  DESIGN  PROBLEM 

A  complex  model -following  design  problem  will  be  carried  out  in  this 
section.  We  seek  an  optimal  control  law  that  will  force  a  small  subsonic 
jet  airplane  to  have  a  dynamic  response  similar  to  the  response  predicted 
by  the  proposed  supersonic  transport's  equations  of  motion.  That  is,  the 
small  subsonic  transport's  equations  of  motion  will  yield  the  F/t  and,  Q/o 
matrices  of  Equation  7-91  while  the  supersonic  transport  will  yield  the  L 
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matrix.  The  problem  will  be  limited  to  one  flight  condition,  since  the  objec- 
tive  is  to  demonstrate  procedures  rather  than  the  execution  of  a  complete  de- 

sign.  Specifically,  a  heavily  loaded  subsonic  jet,  flying  at  sea  level  and  a 
M&ch  number  of  0.2^  will  Ka  .  i  ±  1.1 _  1 _ 1  « 

- — ■' *#****vifc»i,«  a  tiKiuiy  lUOUCU  ©  UPCT  SODIC 

transport  flying  at  sea  level  and  a  Mach  number  of  0.  23. 

The  matrix  equations  have  the  form: 
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(9-43) 


(9-44) 


,  Jh*  matrix  is  not  used  in  the  model-following  method  (see  Sec- 
7.  7),  For  convenience.  Equation  7-91  is  reproduced  below. 
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For  the  given  flight  condition,  certain  matrix  entries,  which  were 
smaller  than  the  next  most  significant  entry  by  a  factor  of  approximately  100, 
were  excluded.  Thus  the  matrices  used  in  this  design  were  (these  are  the 
same  as  given  in  Equations  9-22  and  9-23): 
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The  [io-fy]'* matrix  is  given  below.  The  fXs-LJ’*  is  not  shown,  since 
it  has  exactly  the  same  form  when  the  entries  are  changed  from  f's  to  Jt 's. 
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The  only  remaining  unknowns  are  the  Q  and  R  matrices.  These  are  de¬ 
termined  as  soon  as  one  decides  which  variables  are  to  be  controlled  and  which 
controls  are  to  do  the  controlling.  In  this  problem*  two  controls  are  available 
to  control  four  output  variables.  At  this  point*  we  make  the  subjective  decision 
to  control  two  of  the  four  outputs  with  the  throttle  and  elevator.  The  variables 
&V  and  Atf  are  selected.  The  desired  performance  index  is: 


so  that 


(9-50) 


(9-51) 


161 


and 


10  jc 
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As  noted  in  Section  7.  7,  the  unwanted  error  terms  can  be  excluded 
from  the  performance  index  using  either  the  H  or  Q  matrix.  Here  it  was 
elected  to  use  the  Q  matrix.  The  result  which  would  have  been  achieved  if  the 
H  vector  had  been  selected  in  reality  amounts  only  to  rewriting  Equation  9-51 
in  the  form: 
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The  expression 
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in  Equation  9-45  becomes 
0  0 
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Equation  9-55  can  then  be  defined  to  be 
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where  W  represents  a  2  x  2  matrix  of  transfer  functions.  The  root  square 
locus  is  defined  by  the  equation 
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The  next  task  is  the  one  of  computing  W.  The  routine  multiplication  of 

0  0  10' 


gives 
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After  eubatituting  in  numerical  value*  and  clearing  through  to  the  standard 
transfer  function  form,  one  obtains 
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(9-63) 
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We  are  now  ready  to  proceed  with  the  analysis  of  the  root  square  locus. 
The  root  square  locus  expression  is 
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Before  proceeding  further*  an  expression  for  Z  =  det  W  must  be  obtained. 
After  considerable  manipulation,  one  obtains 


(9-68) 
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Substituting  in  numerical  values  and  placing  the  result  in  standard 
transfer  function  form  gives 


(9-69) 


The  roots  of  Equation  9-67;  as  a  function  of  q'a  and  r's,  can  be  analysed 
using  the  block  diagram  of  Figure  40,  or  one  may  proceed  using  a  similar  but 
more  direct  method  which  is  described  next. 


Figure  40.  Unity  Feedback  Block  Diagram  for  Finding 
Closed- Loop  Poles 

the  objective  of  the  analyses  is  to  obtain  a  valid  approximate  expres¬ 
sion  for  the  root  square  locus  that  will  disclose  the  basic  pattern  of  the  closed- 
loop  roots.  (This  more  direct  method  is  possible  because  the  relative  impor¬ 
tance  of  the  transfer  functions  of  the  root  square  locus  change  as  a  function  of 
the  q's  and  r's. ) 

As  a  first  step,  rewrite  Equation  9-67  as 


and  investigate  the  roots  of  the  equation 
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using  a  Bode  plot  and  the  ratio 
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The  Bode  plot,  as  a  function  of  ,  is  given  in  Figure  41,  From 

this  figure,  it  is  seen 
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is  a  very  conservative  estimate  for 
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Thus  the  root  square  locus  expression  reduces  to 

=  0  (9-75) 

for  0  <  <tx/lf  <  105. 

Again,  go  back  to  Equation  9-67,  this  time  rewriting  it  in  the  form 

and  investigate  the  expression 
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using  the  ratio 
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The  Bode  plot  of  Figure  42  shows  this  result.  Notice  that  for  a  value 
of  fxlff  =10,  the  open  loop  is  10  db  less  than  one.  Even  when  =  100, 

the  frequency  range  over  which  the  open  loop  is  <  1  is  still  considerable  (i.e., 
0  <  a)  <45  rad/sec).  As  the  second  approximation  we  assume 
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or  for  rtlr,  A  100,  &  <  20  rad/sec. 

Equation  9-76  la  now  identical  to  Equation  9-75,  which  was  obtained 
using  a  different  approximation.  Thus  we  have,  so  far,  for  the  root  square 
locus,  the  expression 
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This  analysis  is  shown  in  Figure  43.  We  conclude 
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for  either  0  <  9*/$,  <10*  or  0  <  <  10 

As  a  third  step,  one  now  writes  Equation  9-81  in  the  form 
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We  find  that  a  good  approximation  for  the  root  square  locus  is  now 


+■%■  *1,  WUB-U  -0 

rt  r» 

(9-86) 

for  either 

Hth,  *  *0S  or  r%jrt  *  io 

(9-87) 
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As 

a  fourth  step,  Equation  9-86  is  rewritten  as 

(9-89) 
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The  Bode  plot  for  this  step  is  shown  in  Figure  44.  Our  approximation 
here  again  is  a  function  of  frequency,  but  one  can  safely  conclude 
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Even  for  9tfyf<i  100  ffc/fj ,  the  approximation  breaks  down  only  over  a 
band  of  frequencies  of  approximately  .8  <,  Ot)  <  1,7. 

The  root  square  locus  expression  now  looks  like 
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The  conditions  under  which  Equation  9-92  hold  are  summarized  in  Figure  45. 
The  cross-hatched  area  of  Figure  45  is  the  approximate  area  for  which  Equa¬ 
tion  9-92  remains  valid. 
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Figure  45.  Versus  f*/r, 

Equation  9-92  can  now  be  placed  in  the  form 
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For  ft  !rt 


=  0, 


Equation  9-93  is: 
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Thus  the  closed-loop  roots  can  be  found  using  the  block  diagram: 


Figure  46.  Block  Diagram  for  Approximate  Expression 

This  analysis  is  shown  in  Figure  47  as  a  function  of  ft/fy  .  The  closed- 
loop  poleB  found  using  Figure  47  are  the  roots  of  Equation  9-94.  Since  our  ob¬ 
jective  is  to  move  the  poles  of  the  plant  far  enough  into  the  left-hand  plane  so 
that  they  do  not  interfere  with  the  roots  of  the  modeli  we  should  use  ratios  of 
ft  /Qf  <  100*  For  example*  when 

n/t,  • -oi 

from  Figure  47  one  can  see  that  the  dominant  closed-loop  pole  becomes  the 
open-loop  zero  at  s  =  -1.427*  while  the  other  three  roots  form  a  third-order 
Butterworth  filter  pattern  with  a  natural  frequency  of  approximately  7.5  rad 
per  sec. 

As  f*/<li  decreases,  the  natural  frequency  of  the  third-order  Butter - 
worth  increases,  but  the  dominant  root  at  s  =  -1.427  remains  fixed.  Thus 
the  dominant  closed-loop  root  becomes  the  closest  zero  to  the  origin  of  the 
urtg  transfer  function.  If  we  select  values  of  the  q's  and  r's  that  do  not  lie  too 
close  to  the  cross-hatched  area  of  Figure  45,  one  would  find  that  a  zero  (clo¬ 
sest  to  the  origin)  of  one  of  the  other  transfer  functions  would  become  the  dom¬ 
inant  root. 

«r 

This,  of  course,  is  less  desirable  than  the  present  situation  and  one 
is  forced  to  conclude  that  values  of  the  q's  and  r's  that  lie  within  the  cross- 
hatched  area  are  the  ones  to  investigate  for  the  most  desirable  closed-loop 
response.  One  might  now  proceed  with  a  systematic  investigation  of  the  ex¬ 
pression 

u/fg  &fg  +  Ji.  urff  -  0  (9-95) 

ft  ff 

for  some  typical  values  of  ,  ff  ,  and  ft  which  lie  In  the  cross-hatched  area. 
However,  computer  results,  using  the  exact  root  square  locus  expressions  ver¬ 
ify  that  the  closed-loop  roots  are  essentially  as  predicted  by  the  approximate 
root  square  locus.  It  is  therefore  more  Interesting  to  select  a  set  of  q's  and 
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r's  which  lie  slightly  outside  the  boundary  and  see  how  the  approximate  ex¬ 
pression  compares  with  the  exact  one*  For  the  sake  of  brevity*  we  will  show 
only  one  such  investigation*  The  values  used  were 

=  9t  =  100»  r*  =  10°-  rx  =  1  (9-96) 

Therefore,  q.  / g,  =  1  and  rtfr,  -  .01,  a  point  which  lies  on  the  line  q./q. 

=  100  rtfrt .  1  ' 

The  block  diagram  of  Figure  48  can  be  used  to  investigate  this  case. 


0 


Figure  48.  Block  Diagram  Describing  Approximate 
Root  Square  Locus 

The  first  stage  is  shown  in  Figure  49.  The  left-half  plane  components 
of  C/12f  can  be  read  directly  from  the  Bode  plot.  The  poles  and  zeros  are 
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The  loop  is  closed  again  and  the  result  read  from  Figure  SO.  The 
closed-loop  poles  are  defined  by  the  polynomial  expression 
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(9-98) 


The  damping  factor  in  Equation  9-98  was  found  by  correcting  the 
straight  line  approximation  in  the  neighborhood  of  o>  -6.6  and  then  looking 
up  the  damping  factor  in  any  one  of  a  number  of  standard  tables.  The  optimal 
control  and  feedback  gains  were  then  found  using  Kalman's  computer  program 
and  the  given  values  of  q  and  r.*  The  polynomial  which  resulted  was 

*  As  of  this  writing,  a  computer  program  doe 4  not  exist  for  evaluating  the 
optimal  control  law  and  feedback  gains  using  the  direct  frequency  4omain  ap¬ 
proach  outlined  in  Section  7.  S.  It  is  estimated  that  with  such  a  program,  the 
problem  described  above  could  be  evaluated  in  1/100  hour  of  machine  time  on 
an  IBM  7044.  The  existing  time  domain  program  required  15  minutes  of 
machine  time  for  this  problem. 
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The  agreement  between  the  machine  solution  (Equation  9-99)i  found 
using  all  the  entries  of  the  F  and  G  matrices!  and  the  approximate  root  square 
locus  answer  of  Equation  9-98  is  quite  good. 


The  model  roots  are  defined  by  the  denominator  of  Equation  9-49(  with 
2  's  replacing  the  f's.  That  isf 


Substitution  of  the  values  given  in  Equation  9-47  yields: 


2  (.92) 
1.11$ 


The  locations  of  the  plant  and  model  roots  are  sketched  in  Figure  51. 
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Since  the  preceding  analysis  has  been  quite  lengthy,  it  is  probably 
worthwhile  to  review  the  situation  and  see  what  has  been  accomplished  up  to 
this  point. 

Basically,  we  have  investigated  the  closed-loop  roots  of  the  system  as 
a  function  of  the  parameters  of  the  performance  index  by  using  the  equation 

|  e-d;  |  -  0  (9-100) 

This  equation  was  extracted  from  the  matrix  model-following  Wiener -Hopf 
equation  (7-91).  We  have  yet  to  solve  Equation  7-91  for  the  optimal  control  or 
find  the  optimal  outputs.  In  essence,  the  important  remaining  task  is  to  find 
the  zeros  of  the  optimal  control  in  order  that  the  outputs  of  the  system  can  be 
computed.  Note  that  even  though  values  of  the  q's  and  r's  have  been  selected 
which  give  good  closed-loop  pole  locations,  the  closed-loop  zeros  of  the  sys¬ 
tem  can  still  force  undesirable  transient  responses  if  we  are  unlucky. 

In  finding  the  optimal  system  outputs,  two  courses  may  be  followed. 
One  may  elect  to  stay  in  the  frequency  domain  and  use  the  results  of  Section  7 
or  one  may  uBe  the  time  domain  computer  program.  Here  we  have  elected  to 
use  the  computer  program.  A  brief  summary  of  the  results  is  given  in  the 
transient  responses  of  Figures  52  and  53.  The  feedback  gains  required  are 
tabulated  in  Table  4. 


TABLE  4 

GAINS  SYNTHESIZED  FROM  DESIGN  PROCEDURE 
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From  an  inspection  of  these  figures,  one  would  probably  conclude  that 
while  the  model-following  ability  in &V  is  good,  it  is  poor  (in  fact,  non-minimum 
phase)  in  .  Moreover,  an  inspection  of  the  feedback  gains  shows  the  Afy 
to  $£  feedback  of  19.  3  deg /deg  to  be  approximately  twice  as  high  as  the  max¬ 
imum  allowable . 

If  one  considers  this  situation  to  be  an  unsatisfactory  one,  there  is  no 
recourse  but  to  try  again  -  that  is,  pick  a  set  of  q's  and  r's  that  will  not  only 
give  desirable  closed-loop  poles,  but  also  realizable  feedback  gains  and 
closed-loop  zeros  that  are  conducive  to  acceptable  transient  responses.  In 
this  respect,  our  procedure  is  still  a  trial  and  error  one  -  much  the  same  as 
the  classical  Bode  plot  or  root  locus  methods*  However,  note  that  one  is 
now  working  with  two  controls,  the  elevator  and  the  throttle.  The  effort  ex¬ 
pended  on  the  optimal  design  has  produced  stable  responses  and  clearly  shows 
how  to  select  the  closed-loop  poles*  The  basic  difficulty  that  occurs  with  two 
controls  is  due  to  the  fact  that  the  closed-loop  zeros  of  the  system  can  also 
be  varied.  It  is  in  failing  to  find  the  pattern  of  the  closed-loop  zeros  as  a 
function  of  the  q's  and  r's  that  our  analysis  procedure  breaks  down.  The  reader 
is  probably  well  awure  of  the  enormous  difficulties  presented  by  a  conventional 
trial  and  error  design  when  two  controllers  are  involved. 

The  example  will  be  concluded  at  this  point,  since  the  intent  was  to 
demonstrate  procedures  rather  than  the  execution  of  a  successful  design. 

Before  closing,  however,  a  comment  is  in  order  on  the  high  gains  which  were 
encountered. 

The  high  gains  which  result  are  primarily  due  *o  the  design  philosophy 
which  requires  that  the  phugo.d  roots  of  the  plant  be  pushed  out  past  the  short 
period  roots  of  the  model.  An  alternate  design  philosophy,  which  would  re¬ 
quire  smaller  gains,  is  discussed  briefly  in  the  next  section. 

9.  *1  AN  ALTERNATE  DESIGN  PHILOSOPHY  FOR  MODEL  FOLLOWING 

As  seen  in  the  previous  section,  excessively  high  feedback  gains  were 
required  to  force  the  open-loop  plant  roots  o  migrate  far  enough  into  the  left- 
hali  plane  so  that  the  plant  root  closest  to  th  origin  was  to  the  left  of  the  model 
root  IkJ  the st  from  the  origin.  This  may  have  been  expected,  since  a  siti  ation 
was  being  forced  which  required  the  low  frequency  phugoid  roots  of  the  plant 
to  *  acrease  in  frequency  on  the  order  of  four  or  five  decades.  It  can  be  argued 
than;  this  design  philosophy  does  not  take  advantage  of  the  large  (for  most  air¬ 
craft)  separation  between  the  phugoi  l  and  short  period  frequencies. 

A  design  philosophy  that  would  take  advantage  of  this  separation  might 
be  Btated  as  follows: 

1.  Move  the  phugoid  roots  of  the  plant  one  or  two  octaves 
above  those  of  the  model  phugoid 

2.  Move  the  Bhort  period  roots  of  the  plant  one  or  two  octaves 
beyond  those  of  the  model. 

The  situation  is  depicted  in  Figure  54. 
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Figure  54.  Plant  and  Model  Roots  for  Alternate  Design  Philosophy 

It  can  then  be  argued  that  the  initial  response  will  depend  only  on  the 
short  period  roots  of  the  model  and  plant  with  the  model  short  period  roots 
dominating.  In  a  similar  manner,  the  phugoid  mode  response  will  be  domi¬ 
nated  by  the  model  phugoid  roots. 

It  is  fairly  obvious  that  if  "good"  model  following  can  be  achieved  with 
this  philosophy,  the  resultant  gains  will  be  considerably  lower  than  those  re¬ 
quired  in  the  design  effort  of  the  previous  section. 
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SECTION  10 


CONCLUSIONS 


Linear  optimal  control  can  be  developed  into  an  efficient  and  effective 


1. 

control  system  oesign  tool,  me  c  name  ter  istioa  of  guai aut«cu  stability!  til' 
possibility  for  a  smooth,  well-behaved  response  without  excess  control  mo* 
tion,  and  the  probability  of  rapid  machine  synthesis  for  multi-controller, 
multi-output  systems  make  the  usage  of  the  technique  very  attractive. 


2.  Linear  optimal  control  does  not  have  universal  applicability.  The 
fact  that  the  performance  index  is  of  quadratic  form  a  priori  determines  the 
type  of  distribution  of  the  closed-loop  poles  of  the  system.  The  quadratic  per¬ 
formance  index  defines  the  system  function  whose  excess  poles  over  zeros 
quickly  tend  toward  a  Butterworth  distribution  at  the  closed-loop  natural  fre¬ 
quency.  For  many  applications,  this  approximation  to  a  flat  frequency  re¬ 
sponse  and  a  smooth,  well-behaved  transient  response  is  desirable.  For  air¬ 
craft  stability  augmentation  systems,  with  a  human  in  outer  loops,  the  quad¬ 
ratic  criterion  may  not  be  the  most  desirable.  It  is  felt,  however,  that  a 
flight  control  system,  properly  designed  by  linear  optimal  techniques,  would 
be  acceptable  to  a  pilot. 

3.  The  time  domain  solutions  to  the  problem  and  the  frequency  domain 
solutions  are  generally  equivalent  and  complementary.  The  common  link  is 
the  root  square  locus  expression  or  analogous  Bode  plot  technique.  The  multi- 
variable  root  square  locus  expression,  originally  developed  after  minimization 
in  the  time  domain,  appears  also  in  the  frequency  domain.  This  expression 
relates  the  parameters  of  the  performance  index  to  the  closed-loop  poles  of 
the  optimal  system. 


4.  A  model  can  be  used  to  specify  a  dynamic  response  if  other  than  a 
Butterworth  approximation  for  the  closed-loop  system  is  desired.  For  a  good 
approximation  to  the  model,  however,  more  than  the  root  square  locus  expres¬ 
sion  for  the  closed-loop  poles  is  needed.  An  expression,  not  obtained  in  this 
report,  is  needed  for  the  closed-loop  zeros  of  the  multi- controller  optimal 
system  when  the  system  is  perturbed  by  a  command  input  or  a  disturbance. 

5.  Linear  optimal  control  system  analysis  is  significantly  simpler  than 
conventional  trial  and  error  analysis.  One  root  square  locus  per  controller 
and  per  output  is  required  regardless  of  the  order  of  the  system.  In  conven¬ 
tional  design,  a  complete  analysis  requires  an  investigation  of  feedback  from 
each  state  variable  as  well  as  to  each  controller  from  each  output. 

6.  It  appears  that  a  wide  variety  of  system  excitations,  including  both 
command  and  disturbance  inputs,  can  be  easily  included  in  the  linear  optimal 
control  problem.  In  the  time  domain,  it  is  a  relatively  simple  matter  to  at¬ 
tach  a  vector  describing  a  deterministic  input  to  the  plant  description.  In  the 
frequency  domain,  any  input  that  has  a  Laplace  transform  can  be  included  in 
the  problem  formulation,  including  statistical  inputs  with  well  defined  corre¬ 
lation  functions.  In  any  case,  the  regulator  part  of  the  optimal  system  is  in¬ 
variant  under  different  inputs  and  can  be  separately  analyzed. 
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7.  The  linear  optimal  control  problem  can  be  generalized  to  include  a 
performance  index  involving  any  quadratic  form  of  output  and  its  time  deriva¬ 
tive  along  with  the  control  and  its  time  derivative. 

8.  Single  controller  linear  optimal  control  problems  are  solvable  simply 
and  directly  by  using  the  root  square  locus  to  spectral  factor  a  scalar  expres¬ 
sion. 


9.  This  report  describes  a  direct  method  for  solving  matrix  Wiener  =Hopf 
equations  which  does  not  require  the  factorization  of  a  rational  matrix.  The 
technique  is  a  general  one  which  can  be  applied  directly  to  Wiener -Hopf  equa¬ 
tions  which  arise  in  other  branches  of  engineering  and  mathematics. 
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APPENDIX  I 

DEVELOPMENT  OF  H[ls-pJ  *G  AS  A  MATRIX  OF  TRANSFER  FUNCTIONS 

The  purpose  of  this  appendix  is  to  demonstrate  that  the  matrix  F[ls-Fj  G 
represents  a  matrix  of  transfer  functions  relating  all  the  outputs  of  the  system 
to  the  inputs.  Consider  the  set  of  first-order  equations  of  motion: 

'i'F’x+Gu  (1-1) 


Taking  the  Laplace  transform  of  Equation  1-1  and  solving  for  Y(s)  yields 
V(sJ*  h[Is-f]''  Gu(s)  x(0)  » 0  (1-2) 

It  will  be  shown  that  the  matrix  is  a  weighting  function  or 

transfer  function  matrix  defined  by: 


W(s)  - 
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■few 


A(sl 

*f 
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H[r  s-f]"'g 


d-3) 


To  show  this,  take  the  Laplace  transform  of  Equation  1-1  (initial  conditions 
=  0) 


[r«-F]  X(s)  =  Gul s) 


y(s)  =  KViiS/ 


d-4) 


Using  Cramer's  Rule  to  solve  for  the  individual  transfer  functions 
/ uj  (5)  ,  and  arranging  the  individual  transfer  functions  as  in  Equations 
1-3,  it  is  found  that  Equation  1-3  and  the  matrix  of  transfer  functions  found  by 
Cramer's  Rule  are  the  same.  It  may  then  be  concluded  that  the  "transfer 
function"  matrix 

w(s)  =  h\is-f\''G 

is  a  general  matrix  form  of  Cramer's  Rule  for  finding  transfer  functions. 


Consider,  as  an  example,  the  following  two-input,  two-output  second 
order  system  expressed  as  two  first-order  differential  equations: 
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A  flow  diigrtm  of  this  system  can  be  sketched  as  shown  below: 


Figure  1-1.  Flow  Diagram  of 
Two-Input,  Two-Output  System 


By  substituting  for  the  integrators  their  Laplace  transform  equivalent 
*/s  ,  and  by  using  conventional  signal  flow  techniques,  the  transfer  function 
%•  /iij(s)  can  be  determined  by  inspection: 
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s-fff  -^Iil  [«■«]  9al 

"^1/  ***^11.  -  9i»  9ii  J  L  ««W 

(/if*)  Afi  1«i  (•)  ( I  -  8 ) 
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The  individual  transfer  functions  then  are: 

Iff  •  A* 

*f  ,  ,  9|f  s* A*  9,f 8 “  ^ff  As  *  ft/  As 

«f  <S  =  •-*«  -A,  =  DM  tf-9> 

-Af 

Also,  solving  for  %,/ut  it)  ,  ^t/u,  (%)  ,  and  **A/  (s)  yields  expressions  identical 
to  those  of  Equation  1-6.  Solving  for  (fr/fty  (9)  ,  fsj,  %/&»  (9)  ,  end 

Vi/ut  (s)  will  then  yield  expressions  identical  to  Equation  1-7. 

The  same  transfer  functions  can  be  found  by  using  Equation  I- 10. 
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J 

V(s) 


This  development  demonstrates  that  the  same  result  is  obtained  by 
using  either  Cramer's  Rule,  signal  flow  techniques,  or  by  direct  matrix 
algebra. 
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APPENDIX  II 

DEVELOPMENT  OF  C  |BY  MINORS 

The  expression  for  the  root  square  locus  of  multiple-input,  multiple  - 
output  systems  rapidly  becomes  complex  as  th«  nnmV>A»>  of  control?  becomes 
greater  than  one,  although  a  fairly  straightforward  calculation  based  upon 
first-  and  second-order  minors  of  the  original  system  and  input  matrices  will 
yield  the  proper  root  square  locus  expression.  To  show  how  this  minor  ex¬ 
pansion  comes  about,  consider  the  fourth-order,  two  input  system  described 
by  the  following  matrices 
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The  root  square  locus  expression,  as  before,  is  given  by: 


I  [-Is-F'J  U'QH&s-r]'1  G  |  -  0 


(II-2) 


where  [r*-Fj  ^indicates  the  adjugate  of  a  matrix;  D  is  the  determinant  of  the 
matrix  /I %-F\  . 


form: 


The  adjugate  of  the  matrix  [is  -  P ]  can  be  expressed  in  the  following 
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This  expression  is  almost  prohibitively  complex,  and  would  normally 
require  computer  operation,  but  the  last  six  terms  can  be  simplified  consid¬ 
erably  by  showing  that  the  determinants  such  as 

N„  A !n 

*v  *tt 

can  be  expressed  as  second-order  minors  of  the  original  system  and  input  ma¬ 
trices. 


From  Equation  II - 4  the  expression  Nn *n -N,t *ti  can  be  obtained  as  a 
function  of  the  minors  of  the  original  system  matrix. 
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(II-8) 
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Using  the  determinant  identity 

AAab,a<t  *AabAod~AadA<4  (II- 10) 
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where 


where  a,  c  are  deleted  rows  of  a  determinant 

b,  d  are  deleted  columns  of  a  determinant 

The  resulting  identities  become 
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where  Atftn  is  a  second  ordered  minor  of  the  original  F  matrix.  Specifically, 
for  Aff>22  the  result  is 
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The  six  equations  above,  Equations  II- 11a  through  II- Ilf,  can  be  expressed 
in  terms  of  the  original  F  matrix,  with  the  G  matrix  substituted  for  the  first  two 
columns  of  the  F  matrix.  Specifically,  the  result  is 
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and  the  term 
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is  exactly  equal  to  the  expression 
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Similarly,  the  other  terms  of  the  root  square  locus  expression  are  of  the 
same  form  as  indicated  above.  For  instance,  the  term 
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The  basic  importance  of  the  equivalents  given  above,  such  as  Equations 
11-14  and  11-15,  Is  the  elimination  of  the  exponent  of  the  D*  and  0*  terms  in 
the  denominators  of  the  expressions.  It  was  assumed  from  the  beginning  of 
the  multivariable  root  square  locus  expansion  that  a  DlB*  term  could  not  exist. 
Therefore,  DB  had  to  be  common  to  both  the  numerators  and  denominators  of 
these  expressions. 
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